-- Logs begin at Tue 2022-05-10 16:54:01 UTC, end at Tue 2022-05-10 18:12:26 UTC. -- May 10 17:29:14.279562 dv-cinder-841302-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 17:29:14.290651 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 17:29:14 2022] *** May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: nodename: dv-cinder-841302-2-iscsi May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: machine: x86_64 May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: clock source: unix May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: pcre jit disabled May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: detected number of CPU cores: 4 May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: current working directory: / May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: detected binary path: /usr/bin/uwsgi-core May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: your processes number limit is 47680 May 10 17:29:14.292818 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: your memory page size is 4096 bytes May 10 17:29:14.293449 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: detected max file descriptor number: 2048 May 10 17:29:14.293449 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: lock engine: pthread robust mutexes May 10 17:29:14.293449 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: thunder lock: enabled May 10 17:29:14.293449 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 17:29:14.293449 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 17:29:14.341190 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: Python main interpreter initialized at 0x561fe0f479c0 May 10 17:29:14.341190 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: python threads support enabled May 10 17:29:14.341190 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: your server socket listen backlog is limited to 100 connections May 10 17:29:14.341190 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: your mercy for graceful operations on workers is 90 seconds May 10 17:29:14.341597 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: mapped 403077 bytes (393 KB) for 2 cores May 10 17:29:14.341597 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: *** Operational MODE: preforking *** May 10 17:29:14.341923 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: *** uWSGI is running in multiple interpreter mode *** May 10 17:29:14.341923 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: spawned uWSGI master process (pid: 80240) May 10 17:29:14.342138 dv-cinder-841302-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 17:29:14.345881 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: spawned uWSGI worker 1 (pid: 80254, cores: 1) May 10 17:29:14.345881 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: spawned uWSGI worker 2 (pid: 80255, cores: 1) May 10 17:29:14.345881 dv-cinder-841302-2-iscsi devstack@keystone.service[80240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 17:29:20.221450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:29:20.221450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes May 10 17:29:20.222735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:29:20.222735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: from cryptography.utils import int_from_bytes May 10 17:29:20.223186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:29:20.223186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: from cryptography.utils import int_from_bytes May 10 17:29:20.223327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:29:20.223327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes May 10 17:29:20.274382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:29:20.274563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:29:20.274780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] command line args: [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:29:20.275007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:29:20.275177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ================================================================================ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:29:20.275267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:29:20.275463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:29:20.275558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] admin_token = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.275695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] command line args: [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:29:20.275784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_dir = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.275859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.275925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:29:20.276099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] config_source = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ================================================================================ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:29:20.276257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] debug = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_dir = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.276954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] config_source = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.277110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] debug = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.277299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.277543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.277724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_config_append = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.278975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279048 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_dir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_config_append = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.279949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_dir = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.280954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.281337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.281525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.281745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.281946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.282923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.283314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.283568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.283772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.283951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.284898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] publish_errors = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.285875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] publish_errors = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.286960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] standard_threads = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.287876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_journal = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.288879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_json = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] standard_threads = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_stderr = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] use_syslog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.289896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.290032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.290172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.290304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_journal = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.290304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_json = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.290563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.290693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_stderr = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.290831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.290962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] use_syslog = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.291098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.291229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:29:20.291358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.291528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.291670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.291802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.291931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.292966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.293946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.294915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.295917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.296875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.297960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.298888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.300094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.301208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.302584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.303865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.303865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.304135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.304269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.304400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.304707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.304943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.305152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.305152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.305541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.305541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.305980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.306150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.306150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.306150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.306150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.306150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.307023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.307250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.307500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.307744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.307946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.308116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.308313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.308541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.308721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.308957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.309164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.309332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.309332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.309720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.309884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.310934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.311947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.312953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313217 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.313882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.314405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.314559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.314694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.314825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.315959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.316951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.317890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.318135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.318275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.external = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.318935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.319915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.password = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] auth.token = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.320946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.321937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.322968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.323930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.324899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.325939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.external = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.password = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.token = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.326973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.327943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.328963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.329977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.330992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.331949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332622 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.332988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.333776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.333927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.334703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.334841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.334972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.335863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.336962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.337919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.338873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.339902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.340972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.341930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.342998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.343980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.344909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.345881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.346946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.347950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.348930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.349135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.349287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.349427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.349565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.350913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.351202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.351341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.351608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.351755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.351900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.352908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.353990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.354906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.355885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.356957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.357901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.358997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.359883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.360878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.361960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.362921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.363968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.364954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.365096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.365303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.365974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.366251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.366438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.366667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.366839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.366981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.367864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.368869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.369864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.370875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.371864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.372754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.373897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.374195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.375458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:29:20.376675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:29:20.398602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.399319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.399319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.400441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.400441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.400441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.407993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.408351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.438221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.438571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.438758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.439485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.493639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.495188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.546379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.546592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.547724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.547959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.616992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.617132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.617224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.617349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.617429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.617559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.641627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.641854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.641982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.642949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.643074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.643284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.655261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.655411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.670689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.670890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.670969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.671546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80255) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.673794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 17:29:20.690430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.690681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 17:29:20.690961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.691163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 17:29:20.691308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.691459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 17:29:20.691587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.691714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.691839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.691982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 17:29:20.692108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.692235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.692366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.692490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.692673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.692928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.704109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.704385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.704653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.704779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.704921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.705049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.705223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.705500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.713407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.713893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.716752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.717029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.717241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.717368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.717507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.717688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.717816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.717972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.718975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.719812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.720079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.747169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.747452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.748810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.749013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.749167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.749301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.754421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.754596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.754736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.754883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.755014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.755156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.762981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.763154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.763302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.763461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.767955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.768108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.768239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.768380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.768510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.768638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.768777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.768905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.769940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.788594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.788874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.789052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.789338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.793417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.793936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.797064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.797355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.797650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.797945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.802318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.803657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.806599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.807298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.813786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.813786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.813786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.814499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.814638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.814861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.815477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.833226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.833776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.834177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.834296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.834493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.834766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.835126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.835639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.842924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.844522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.844703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.844980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.846256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.846531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.848118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.848404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.848687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.849328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.849650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.849752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.850018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.850391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.850697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.850980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.863294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.863607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.864340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.864772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.864871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.865068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.865715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.865952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.866038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.866234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.866419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.866864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.867153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.867450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.885372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.886356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.888760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.889721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.892141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.893113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.893778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.894730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.895469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.895753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.896047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.896423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.896881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.897269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.903749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.904954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.905390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.906575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.908985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.909286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.909573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.909842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.909992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.910126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.910399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.910674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.919466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.919768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.920051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.920238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.920532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.920809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.928799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.929081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.929362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.929561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80255) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 17:29:20.929700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.929831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.929971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.930930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.931982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.932924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80255) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 17:29:20.972542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561fe0f479c0 pid: 80254 (default app) May 10 17:29:20.972908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561fe0f479c0 pid: 80255 (default app) May 10 17:29:20.976330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd53f5-0e90-4ef4-ad7e-4ad346c08e62 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:20.976640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd53f5-0e90-4ef4-ad7e-4ad346c08e62 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:20.976936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd53f5-0e90-4ef4-ad7e-4ad346c08e62 None None] PATH_INFO: `/v3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:20.981223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Tue May 10 17:29:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:29.209800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:29.210400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:29.210400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:29.214689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:29.220015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:29.220479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:29.220643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:29.252204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG oslo_db.sqlalchemy.engines [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:29:29.453150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80254) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 17:29:29.453584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80254) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 17:29:29.510806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:29.512367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:29.639814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 17:29:29.777847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:29.812759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG oslo_db.sqlalchemy.engines [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:29:29.941125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6cf20-94fa-4564-ab9a-901898b6ae61 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:29.945583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:29.946291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:29.946534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:29.946819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:29.955206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:30.007782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 17:29:30.008129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657ebd0-9e79-4ec3-a7a7-67af9ac50e40 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:30.018243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Tue May 10 17:29:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 17:29:30.024825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:30.039975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bda29-3025-4da7-a7c1-33745064f4e8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:30.044498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:30.045621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:30.045910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:30.046189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] PATH_INFO: `/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:30.047736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] RBAC: Authorizing `identity:get_project(project_id=05b43e5ee8d94e7eabaa576aaa97efc1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:30.099314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 17:29:30.099876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52dd60-5462-41e5-a3a8-4a336b51c70c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:30.104643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Tue May 10 17:29:30 2022] GET /identity/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:32.324435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064908-3c74-4276-ba87-7ee6a04c30f9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:32.324991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064908-3c74-4276-ba87-7ee6a04c30f9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:32.324991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064908-3c74-4276-ba87-7ee6a04c30f9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:32.329202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:32.335275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:32.335790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:32.336016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:32.356844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:32.358451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:32.367438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 17:29:32.390382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064908-3c74-4276-ba87-7ee6a04c30f9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:32.403183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064908-3c74-4276-ba87-7ee6a04c30f9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:32.408524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:32.409214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:32.409504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:32.409789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:32.419536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:32.421490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ca87c-e5ea-4504-ab35-0463400a9c83 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:32.431905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Tue May 10 17:29:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 17:29:32.439299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:32.449188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9dce7-1585-43b5-a7b2-fad230a2f40d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:32.453987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:32.454899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:32.455187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:32.455499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:32.457046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:32.458996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ff8fc-f49f-49ab-8a05-023e7f41952f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:32.460810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Tue May 10 17:29:32 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:34.785468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb0d4-0a2a-4429-a8e8-72a8d911c22f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:34.786010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb0d4-0a2a-4429-a8e8-72a8d911c22f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:34.786096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efb0d4-0a2a-4429-a8e8-72a8d911c22f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:34.787690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:34.793327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:34.793780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:34.793906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:34.843590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f2c6-51cf-4d77-861b-f2ed1449cced None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:34.843886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f2c6-51cf-4d77-861b-f2ed1449cced None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:34.844334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057f2c6-51cf-4d77-861b-f2ed1449cced None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:34.845896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:29:34.851982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:34.852382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:34.852733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:34.896840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG passlib.handlers.bcrypt [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80255) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 17:29:34.897347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG passlib.handlers.bcrypt [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80255) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 17:29:34.922882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:34.924173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:34.945733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:34.947407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:35.012860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:35.038708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.063063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:35.085608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.146908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb672c8-6882-4c98-bcc8-20d4307dfa78 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.182206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.183023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.183359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.183661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.191280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34574b79-3300-4612-87a1-37e6e6e56a97 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.197036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:35.208398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:35.210656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:35.211495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:35.215076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:29:35.216065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.227890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.228815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.229105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.229390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.303602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.305558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.323169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e401d6-5eeb-47f8-8a0e-8fd882aaaebc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.360239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.360982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.361274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.361551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.362327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:35.362641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.364112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.377194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:35.382727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.416483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 17:29:35.422064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.486274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be151-7a54-4291-a0a8-98511e3f3cfe None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.524907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fe306-c140-4c9f-a8ee-42eb0f074d5d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.525466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.526521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.526814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.527922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.529195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.530679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.537803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:35.540211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.560089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.560814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.561102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.561382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.653228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd57ee-a6e8-4ec2-b0b4-8c8836200b0f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.690896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.691759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.692023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.692300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.692580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.693805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.694440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.695919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.697758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:35.703210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:29:35.715407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:35.716308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:35.717110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:29:35.717110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:29:35.717110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:29:35.717110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:35.717110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:29:35.722519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:35.807356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fe3a2-0cd6-4c79-a334-c9e250b34788 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.827126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e69d6-9129-4c11-98ff-67e71ee9d4ac None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:35.850128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.851378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.851701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.851984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.852838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.domain.id=default, user.id=cf223ad1bb814591a9871f0dc159ef4b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:35.853157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c06d64-9a7b-4fbc-967f-12522dd0b9eb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.862564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/role_assignments?user.id=cf223ad1bb814591a9871f0dc159ef4b&scope.domain.id=default&role.id=0d49494e76f84242bc3076803ab15e82 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:35.864188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:35.865599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:35.865993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:35.866303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:35.867099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:35.867450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:35.868900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578d94-0289-49e7-a167-6b4b3c4065b4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:35.891394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:38.585258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2e93-886e-42a3-9dc6-d056198b5a2a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:38.585811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2e93-886e-42a3-9dc6-d056198b5a2a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:38.585811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a2e93-886e-42a3-9dc6-d056198b5a2a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:38.587559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:38.601461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:38.601990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:38.602072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:38.623265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:38.624515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:38.710616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:38.757477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2e93-886e-42a3-9dc6-d056198b5a2a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:38.871387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a2e93-886e-42a3-9dc6-d056198b5a2a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:38.907799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:38.908607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:38.908895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:38.909176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:38.921272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:38.929447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:38.930303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:38.931058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 13/24] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:29:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:38.936561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.081352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c9621-0e95-4c78-805f-da6b283866ea None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.126905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.127609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.127899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.128232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.129059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:39.129400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.131717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b34cd-e601-4187-9c91-4fbf868aebd6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.149700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 12/25] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:39.155750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.173290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307b90-c15c-405e-9145-5c0ab05932b8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.173609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307b90-c15c-405e-9145-5c0ab05932b8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.173881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e307b90-c15c-405e-9145-5c0ab05932b8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.175600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:39.181392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ea1d-f883-4877-a8da-e05c055ce73b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.181691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ea1d-f883-4877-a8da-e05c055ce73b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.181973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371ea1d-f883-4877-a8da-e05c055ce73b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.184186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 14/27] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:29:39.185584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a963a-87a8-4e59-8dd3-ace1996fc597 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.185872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a963a-87a8-4e59-8dd3-ace1996fc597 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.186150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a963a-87a8-4e59-8dd3-ace1996fc597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.209770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-058a963a-87a8-4e59-8dd3-ace1996fc597 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:39.211867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-058a963a-87a8-4e59-8dd3-ace1996fc597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:39.299857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 15/28] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:39.301494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.301911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.302396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.324420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:39.326062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:39.371503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baeaf7-7bec-4fb6-8104-61d53273bd89 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.410762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.411803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.412869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.413258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.414806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.416812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.417802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 16/29] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:39.418882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.418989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 14/30] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:39 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:39.424773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.560432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd75c4-7428-409e-b212-5fbcc2827a92 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.582967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5472137-bb29-489a-95e3-2bc224309100 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.610573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.611768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.612178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.612629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.626575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.628148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.628607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.629077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.629198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.631251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.632620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.633236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.635521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 15/31] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:39.636711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:29:39.661607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:39.663235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:39.664107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:29:39.664107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:29:39.664107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:29:39.664107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:39.664884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:39.666525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:39.753953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b7e31-25d9-4cb9-abcf-ddbc6a44dff9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.793195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.794240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.794733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.795228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.796304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.797888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.811408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24392c-2e4b-47ee-b83f-1c154dbe55af None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:39.891241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:39.892262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:39.892557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:39.892968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] PATH_INFO: `/v3/domains/default/users/cf223ad1bb814591a9871f0dc159ef4b/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:39.895478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cf223ad1bb814591a9871f0dc159ef4b, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:39.897705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:39.994420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 16/33] 10.222.0.60 () {60 vars in 1131 bytes} [Tue May 10 17:29:39 2022] POST /identity/v3/roles => generated 219 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:39.995967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:40.119998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 18/34] 10.222.0.60 () {58 vars in 1361 bytes} [Tue May 10 17:29:39 2022] PUT /identity/v3/domains/default/users/cf223ad1bb814591a9871f0dc159ef4b/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:29:40.205686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cb206-f3cb-4eb7-a935-a0f143114ee6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:40.247183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:40.248413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:40.248952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:40.249538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:40.250686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:40.251221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:40.253279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf24207-2eeb-418a-a57a-a7ed526c75d2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:40.276474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:40.284244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:40.444083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f8a6b-c8ce-41ce-88b1-a1c7ad439505 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:40.492725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:40.493462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:40.493795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:40.494040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:40.494821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:40.496644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035020c8-52db-4d49-863e-9cd292db02ca None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:40.549312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 19/36] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:29:40 2022] POST /identity/v3/projects => generated 301 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:40.942130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca422ed-03e6-408f-afc7-fabcd842a6bf None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:40.943852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca422ed-03e6-408f-afc7-fabcd842a6bf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:40.944563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca422ed-03e6-408f-afc7-fabcd842a6bf None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:40.946280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 18/37] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:40.954347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c648-4065-48f2-aa1c-95f360dacdd9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:40.954864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c648-4065-48f2-aa1c-95f360dacdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:40.954969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c648-4065-48f2-aa1c-95f360dacdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:40.980620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6964c648-4065-48f2-aa1c-95f360dacdd9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:40.982781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6964c648-4065-48f2-aa1c-95f360dacdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:41.082353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 20/38] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:41.110484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca422ed-03e6-408f-afc7-fabcd842a6bf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:41.261581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca422ed-03e6-408f-afc7-fabcd842a6bf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:41.301243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:41.302373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:41.302885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:41.303391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:41.304387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:41.306685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fafae1-dad9-4d59-bb92-eaf5a31971ac None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:41.327756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1131 bytes} [Tue May 10 17:29:41 2022] POST /identity/v3/roles => generated 225 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:29:41.415898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4181b57-e29f-4f96-83f8-a768c274677c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:41.416433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4181b57-e29f-4f96-83f8-a768c274677c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:41.416930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4181b57-e29f-4f96-83f8-a768c274677c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:41.419759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 21/40] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:41.425621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7a0-78f1-458d-806f-4a56585dd015 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:41.426223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7a0-78f1-458d-806f-4a56585dd015 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:41.426703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7a0-78f1-458d-806f-4a56585dd015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:41.451663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6abfa7a0-78f1-458d-806f-4a56585dd015 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:41.453933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6abfa7a0-78f1-458d-806f-4a56585dd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:41.554593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 20/41] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:41.616089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4181b57-e29f-4f96-83f8-a768c274677c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:41.768826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4181b57-e29f-4f96-83f8-a768c274677c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:41.817083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:41.818268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:41.818268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:41.819093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:41.820185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:41.822086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfd4b-fd28-42d1-9aaa-99a07ecc147a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:41.844184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1131 bytes} [Tue May 10 17:29:41 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:42.046557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6435b2-fa29-4a36-965b-ffe4bc8bc622 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:42.047066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6435b2-fa29-4a36-965b-ffe4bc8bc622 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:42.047066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6435b2-fa29-4a36-965b-ffe4bc8bc622 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:42.048486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 21/43] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:42.058206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:42.058696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:42.058775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:42.080803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:42.080803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:42.167121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 23/44] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:42.190643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6435b2-fa29-4a36-965b-ffe4bc8bc622 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:42.311741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6435b2-fa29-4a36-965b-ffe4bc8bc622 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:42.351782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:42.352577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:42.352871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:42.353156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:42.354405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:42.355927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de95952-6b63-4cd4-893e-ef57491b2971 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:42.357581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 22/45] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:42.364502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:42.492692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e05b1-05e9-44de-a84d-fc40a8a04a99 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:42.542681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:42.543392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:42.543681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:42.544109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:42.544932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:42.546549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338d5cd-8e55-4581-b075-3760561f1518 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:42.577212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:29:42 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:43.382596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364986-81f0-48eb-bc70-674e1196dfe8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:43.383154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364986-81f0-48eb-bc70-674e1196dfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:43.383154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364986-81f0-48eb-bc70-674e1196dfe8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:43.384568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 23/47] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:29:43.390289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:43.390970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:43.390970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:43.407669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:43.408866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:43.477503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:43.501548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6364986-81f0-48eb-bc70-674e1196dfe8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:43.604051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6364986-81f0-48eb-bc70-674e1196dfe8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:43.637167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:43.637882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:43.638170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:43.638446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:43.648567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:43.656278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:43.657301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:43.658306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 24/49] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:43.664073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:43.762001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e482-ea33-41a5-9c27-9c2321f24664 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:43.800590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:43.801299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:43.801590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:43.801875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:43.804083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:43.804408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:43.805848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:43.815793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 26/50] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:43.821485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:43.922351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225855a0-7d71-422f-88e0-f94203b03c1a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:43.956172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:43.957057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:43.957347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:43.957631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:43.959954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:43.961439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:43.963103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 25/51] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:43 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:43.968673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:44.075986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b7c26-cbce-49d7-a24e-3b9c9c8c46fd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:44.113552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:44.114369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:44.114816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:44.115603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:44.116448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:44.117939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a72e17-5704-4a87-840f-122338e93411 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:44.119686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:44.125570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:44.230922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc4b74-9161-426f-8dea-41974b6dfc0a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:44.266219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:44.266901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:44.267180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:44.267495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:44.268349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.domain.id=default, user.id=cf223ad1bb814591a9871f0dc159ef4b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:44.268664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:44.270169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240dec4-8783-473a-8242-717880e9fc38 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:44.277745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1322 bytes} [Tue May 10 17:29:44 2022] GET /identity/v3/role_assignments?user.id=cf223ad1bb814591a9871f0dc159ef4b&scope.domain.id=default&role.id=0d49494e76f84242bc3076803ab15e82 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:44.901497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda4a6-16c1-4896-9679-c2582f8c828a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:44.902026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda4a6-16c1-4896-9679-c2582f8c828a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:44.902110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda4a6-16c1-4896-9679-c2582f8c828a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:44.903457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 28/54] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:44.908918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:44.909374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:44.909487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:44.927475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:44.928690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:44.992983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 27/55] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:29:45.016215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda4a6-16c1-4896-9679-c2582f8c828a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:45.118241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda4a6-16c1-4896-9679-c2582f8c828a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:45.151446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:45.152254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:45.152548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:45.152829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:45.154029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:45.155608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444870a-8715-46ab-b4fe-dfe3e4167f30 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:45.157252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 29/56] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:45.163585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:45.260710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192a78f-00c6-4277-b774-aba2b2f90e45 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:45.294538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:45.295204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:45.295530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:45.295811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:45.296535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:45.297993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fbecf-a742-4804-9c85-5585619f4ce9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:45.326471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 28/57] 10.222.0.60 () {60 vars in 1140 bytes} [Tue May 10 17:29:45 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:47.722438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941f1e-3855-44c2-87df-1edcd3627846 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:47.723012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941f1e-3855-44c2-87df-1edcd3627846 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:47.723012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e941f1e-3855-44c2-87df-1edcd3627846 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:47.724655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 30/58] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:47.730791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:47.731322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:47.731473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:47.749143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:47.750377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:47.823479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 29/59] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:47.848040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e941f1e-3855-44c2-87df-1edcd3627846 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:47.951769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e941f1e-3855-44c2-87df-1edcd3627846 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:47.983775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:47.984493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:47.984781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:47.985058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:47.986235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:47.987710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17a727-3a10-4e58-a8de-e7724e2c86ab None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:47.989324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 31/60] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:47.995488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:48.090342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238d2c-6563-4972-a13e-038e0e103a20 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:48.123380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:48.124066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:48.124358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:48.124643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:48.125363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:48.126834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a4ef3-bce1-4433-83ca-107ad5f8b343 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:48.151190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 30/61] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:29:47 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:51.737376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5abeaa-8b74-4592-93ad-899299336e43 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:51.738445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5abeaa-8b74-4592-93ad-899299336e43 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:51.738931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5abeaa-8b74-4592-93ad-899299336e43 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:51.741641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 32/62] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:51.747255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6877-4502-41f8-b5cf-b64d67b158e3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:51.748296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6877-4502-41f8-b5cf-b64d67b158e3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:51.749117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6877-4502-41f8-b5cf-b64d67b158e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:51.771706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d6fa6877-4502-41f8-b5cf-b64d67b158e3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:51.773473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6fa6877-4502-41f8-b5cf-b64d67b158e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:51.885977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 31/63] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:51.934059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5abeaa-8b74-4592-93ad-899299336e43 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.048674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ffb80-e576-46da-9320-1cb3078db557 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.049337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ffb80-e576-46da-9320-1cb3078db557 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.049830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ffb80-e576-46da-9320-1cb3078db557 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.051686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 32/64] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:29:52.056919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b448c-fc0d-423a-9279-dcbcc80caad3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.057469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b448c-fc0d-423a-9279-dcbcc80caad3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.057937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b448c-fc0d-423a-9279-dcbcc80caad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.069310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5abeaa-8b74-4592-93ad-899299336e43 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.097886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-936b448c-fc0d-423a-9279-dcbcc80caad3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:52.099206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-936b448c-fc0d-423a-9279-dcbcc80caad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:52.140619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75384740-b77b-4369-8e56-c151d343668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.141854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384740-b77b-4369-8e56-c151d343668a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.142367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384740-b77b-4369-8e56-c151d343668a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.142857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384740-b77b-4369-8e56-c151d343668a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.157162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75384740-b77b-4369-8e56-c151d343668a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-75384740-b77b-4369-8e56-c151d343668a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:52.166666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:52.167618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:52.168442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:52.170837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 33/65] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:52.172390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bf40-a2c2-4b0c-ad3d-29a6ade34e66 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.172879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bf40-a2c2-4b0c-ad3d-29a6ade34e66 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.173365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369bf40-a2c2-4b0c-ad3d-29a6ade34e66 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.175078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 34/66] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:52.180588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369bf40-a2c2-4b0c-ad3d-29a6ade34e66 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.191159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 33/67] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:52.199386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.199960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.200420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.225631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:52.226979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:52.298272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369bf40-a2c2-4b0c-ad3d-29a6ade34e66 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.304713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 34/68] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:52.305323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.341626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.342349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.342639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.342921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.343841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:52.344064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:52.345458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec6c87-7adb-4a6c-92f8-8ed2b1f58dff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:52.354344 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 35/69] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:52.355571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414622f-3ef2-4e2e-a195-3718d37195ba None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.355877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414622f-3ef2-4e2e-a195-3718d37195ba None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.356143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414622f-3ef2-4e2e-a195-3718d37195ba None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.357663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 36/70] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:52.359889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414622f-3ef2-4e2e-a195-3718d37195ba None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.421940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881cfd-644a-4cc3-b25c-0c119d3672aa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.455840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.456639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.456926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.457204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.467236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a987cfdf-c651-46e0-8950-c680a7103081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:52.475165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:52.476075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:52.476855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:52.477818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaa773-ba0f-45cc-ba8a-d101046238e6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.478104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaa773-ba0f-45cc-ba8a-d101046238e6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.478349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaa773-ba0f-45cc-ba8a-d101046238e6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.479799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:52.480331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaa773-ba0f-45cc-ba8a-d101046238e6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.490997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414622f-3ef2-4e2e-a195-3718d37195ba None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.524266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.525081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.525365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.525642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.535499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f7753f06-571e-4433-a13d-9c9e19c02c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:52.544223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:52.545229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:52.546451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:52.547299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.547299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.547729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.565283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:52.566397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:52.590395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaa773-ba0f-45cc-ba8a-d101046238e6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.623003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.623912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.624197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.624477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.625998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:52.627487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696a3ab-c5e2-4788-9798-d8161cab5494 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:52.633757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:52.633757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.633757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.633757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.634878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:52.635776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.650083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:52.651345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:52.717157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 38/76] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:52.718394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.737858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d15629-8077-4510-adf0-bef4cd186bdb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.772771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.773458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.773753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.774040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.774808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:52.775125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:52.776564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:52.784708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 39/77] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:52.785540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.820958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4ccf2-ea5b-4104-ab65-9df9170f56a6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.854679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.855358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.855682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.855966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.856763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:52.857052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:52.858497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:52.867287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:52.868144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:52.884151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e80a8-c622-4ed9-9a5b-4d90113cb243 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.917540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.918199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.918500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.918777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:52.963671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0055031-dcf7-4311-b543-79dd4adef436 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:52.984092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:52.985582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:52.995824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:52.996628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:52.996919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:52.997201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.007233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:53.014897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:53.015742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:53.016489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:53.017107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.086237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:29:53.087019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.115226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6fe6d-ef52-4efc-bbb4-aca168830e54 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.147085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.147915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.148211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.148495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.149692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.151168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.152826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.153613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.181791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba40a-5933-41e4-85d8-efa926a423dd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.214907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.215823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.216118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.216400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.231271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.232789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.234641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.235214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.248569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e38314-ae28-463f-80c4-0c5292508b3c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.281139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.282022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.282314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.282596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.283921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.285376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.288146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.288939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.331833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28257bcd-e353-4d3f-9fdd-670fefa685ab None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.367680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.368275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.368561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.368842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.369608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:53.369917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.371305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.379359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.380373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.390081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea12f4-5a0b-4f68-9dcc-3c15270373cf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.423414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.424289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.424574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.424851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.426052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.428095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.429957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.430739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.482722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fccf8b-c9e3-4ad3-863e-3830c78e6adc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.514710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.515410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.515709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.515994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.516711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.518169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.528883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d085b-6b1e-4948-8911-9cb3eeb6f608 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.547520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 43/86] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:29:53 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:53.548371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.576457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.577374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.577672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.577962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.654375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.655885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.665435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-e261-403a-bc4f-998fdfef336d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.703911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.704600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.704895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.705179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.763417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 44/87] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:29:53.763417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.780865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.782329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.878322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f62a-b8df-481a-9019-d0ada1211c5a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:53.893767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 44/88] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:29:53.895402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:53.916606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:53.917786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:53.918278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:53.918754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:53.920238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:53.921890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:53.923836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:53.924810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.001354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93b575-299b-4f05-9afb-ea0c00fccb84 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.033817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d0905-a5d7-41dd-8042-263a1433b9ec None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.038861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.039887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.040383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.040863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.041920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=cf223ad1bb814591a9871f0dc159ef4b) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:54.042465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.044282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.053155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/role_assignments?user.id=cf223ad1bb814591a9871f0dc159ef4b&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.059764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.071359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.072326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.072622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.072905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.079998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.079998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.079998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:53 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.079998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.181526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de837fb-7226-4f4c-9804-291cc2db0cd5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.223280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.224711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.225214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.225713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.227271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.229054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.231168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 46/92] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.232329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.240076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d6540-d348-49b5-b45b-093988439864 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.279980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.280666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.280957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.281240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.363228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.365352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.423393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda35af-df88-46f4-9770-cbc7aeeabdb2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.475638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 47/93] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:29:54.475638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.480083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.480764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.481087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.481349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.482208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:54.482530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.488211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.509228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.510188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.578038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c9ddf-728a-4e75-a6a8-fa6cd95acebb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.615353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.616225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.616523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.616811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.617697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:54.618025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.619605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.626290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 48/95] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.744895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5b40-f5c5-4d23-8e54-6f28fec72739 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.783107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.784050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.784342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.784621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] PATH_INFO: `/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.785975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=16c2a6a7627a4172ac5e95fec73b51e1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.788359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a154a-0e40-4612-8e62-6a876a912ff3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.790610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:54.796461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:54.949279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d0d0-7684-487b-b0e9-c71415f21dc7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:54.987293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:54.988028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:54.988321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:54.988605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:54.990060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=16c2a6a7627a4172ac5e95fec73b51e1, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:54.990384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:54.991947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5d744-3812-47b4-b2e1-6580bd094a82 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:54.998787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:29:54 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=16c2a6a7627a4172ac5e95fec73b51e1&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:56.594505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593904b-d0f2-440b-a735-9e900440dec9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:56.595248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593904b-d0f2-440b-a735-9e900440dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:56.595248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593904b-d0f2-440b-a735-9e900440dec9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:56.596901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:56.602604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98f1a-b9f0-4c76-acd1-b7eedd198864 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:56.603188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98f1a-b9f0-4c76-acd1-b7eedd198864 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:56.603188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98f1a-b9f0-4c76-acd1-b7eedd198864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:56.626291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-85a98f1a-b9f0-4c76-acd1-b7eedd198864 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:56.627544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-85a98f1a-b9f0-4c76-acd1-b7eedd198864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:56.713683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 50/99] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:56.740159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593904b-d0f2-440b-a735-9e900440dec9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:56.791662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44448-5d18-4534-9881-774b442446ea None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:56.791982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44448-5d18-4534-9881-774b442446ea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:56.792261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44448-5d18-4534-9881-774b442446ea None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:56.793939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 51/100] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:56.807462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:56.807757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:56.808036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:56.848527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:56.849908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:56.859914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593904b-d0f2-440b-a735-9e900440dec9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:56.936593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:56.937640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:56.938069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:56.938646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:56.957063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:56.973221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:56.974767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:56.975576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 50/101] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:56.982549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:57.029810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:57.059127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:57.135126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb016-c724-45c3-8c45-a2f956f4b118 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:57.212304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:57.213313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.213759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.214196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.215169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:57.215680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:57.217306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:57.224026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3e0e2-a4f4-414f-8189-9254883bfa79 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:57.231397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 51/103] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:29:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:57.233715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:57.311577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:57.312391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.312810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.313127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.314621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:57.316148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:57.318825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 53/104] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:29:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:57.327295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:57.414747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e44b-5e8a-4151-939e-4c681d8a9525 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:57.470888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:57.472162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.472667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.473414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] PATH_INFO: `/v3/users/94122d34af804458b831e1f50f7a41a4` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.500470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] RBAC: Authorizing `identity:get_user(user_id=94122d34af804458b831e1f50f7a41a4)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:57.502356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:57.504842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 52/105] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:57 2022] GET /identity/v3/users/94122d34af804458b831e1f50f7a41a4 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:29:57.510603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:57.556765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460360c3-de14-4ee1-a54f-469dbf63f7a9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:57.625137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:57.626699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.627943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.629100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.630067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:57.631990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c945c-57af-4ed0-bb8c-bce3667698a1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:57.660796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 54/106] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:29:57 2022] POST /identity/v3/projects => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:29:57.700034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2659b8-ea34-4cf1-a318-4a65df31f16a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:57.739948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:57.741086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.741572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.742044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.827353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:57.829339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:57.867198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff16fe-0303-4484-afc8-ad7acb424879 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.867528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff16fe-0303-4484-afc8-ad7acb424879 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.867802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff16fe-0303-4484-afc8-ad7acb424879 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.869383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 55/107] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:57.876116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e161c-a39e-4b22-8115-9e152d2645cd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.876420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e161c-a39e-4b22-8115-9e152d2645cd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.876690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e161c-a39e-4b22-8115-9e152d2645cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.898785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-729e161c-a39e-4b22-8115-9e152d2645cd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:57.900071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-729e161c-a39e-4b22-8115-9e152d2645cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:57.984003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 56/108] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:57.989540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381830e6-0cbb-432d-9c84-3b9b354261bc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:57.989874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381830e6-0cbb-432d-9c84-3b9b354261bc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:57.990169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381830e6-0cbb-432d-9c84-3b9b354261bc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:57.991811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 57/109] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:58.000723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 53/110] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:29:58.006492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.006492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.006883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.009243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.035760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:58.037273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:58.126507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 58/111] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:58.130384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.141117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a0abf-74b3-4e8a-939b-cd8749bddd4e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.187635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.188516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.188804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.189088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.190590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:58.192075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318527-3e8c-49d5-bde2-a0b91cfeabf3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:58.194864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 54/112] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:58.196147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dde24-f304-4055-a9a4-2bd726050fdc None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.196487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dde24-f304-4055-a9a4-2bd726050fdc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.196975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dde24-f304-4055-a9a4-2bd726050fdc None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.197972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 55/113] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:58.198734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dde24-f304-4055-a9a4-2bd726050fdc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.250481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb54e-d8e7-4a34-8f09-7918a119d8ef None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.287126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.288055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.288349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.288679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.299858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:58.308486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:58.309426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:58.310186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 59/114] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:58.310836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.325672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dde24-f304-4055-a9a4-2bd726050fdc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.360752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.361618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.361907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.362188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.375395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ad7950ac-2795-4a12-a7a6-a66d3988c6a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:58.384491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:58.385392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 56/115] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:58.387553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.389580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.389580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.430767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:58.432701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:58.437487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fb49d-4b0b-491a-ab89-d01c57abcd59 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.471254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.472042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.472407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.472764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.474268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=94122d34af804458b831e1f50f7a41a4) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:58.474669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:58.476295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:58.486288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 60/116] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/role_assignments?user.id=94122d34af804458b831e1f50f7a41a4&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=5a307067f3634dae958211363357844f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:58.487261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.541324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 57/117] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:58.543443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.638108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481c849-af7d-448d-a76c-4b3d9f3bf660 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.685669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.686321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.686613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.686897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.695818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:58.695818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:58.695818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:58.699212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 61/118] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:58.700122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.716679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532612dc-1d99-4cf7-a474-3ff5c8494274 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.753430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.754460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.755646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.756130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.757178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:58.757722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:58.759314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced01-15aa-48b9-a6e1-57c16e189a8d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:58.768713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 58/119] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:58.775278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312538fe-843e-41d1-a378-30cbd796dba3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.775944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312538fe-843e-41d1-a378-30cbd796dba3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.776469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312538fe-843e-41d1-a378-30cbd796dba3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.778100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 59/120] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:29:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:29:58.779163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312538fe-843e-41d1-a378-30cbd796dba3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.805501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed1fc6-fd28-4aa2-b883-7eadbaf470cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.856487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.857431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.857720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.858052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.870694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:58.879082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:58.880617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:29:58.881584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 62/121] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:58.882237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:58.900708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312538fe-843e-41d1-a378-30cbd796dba3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:58.940281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:58.941575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.942079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.943140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.944748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:58.946528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258af72-159d-4720-b04e-7e4cb6462db7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:58.948579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 60/122] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:58.950099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:58.950601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:58.951100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:58.970184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:29:58.971838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:29:58.996416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24789e6e-8515-4ff4-b52f-06fe681a6eb5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.034388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.035340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.035662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.035999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.037401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.038949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.045174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 63/123] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:58 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.045174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.055904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 61/124] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:29:59.057084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.152736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a52c-b61b-4a06-a75a-8cc50e112d73 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.174728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e98a2-5e04-493d-960f-ddcc0f7e033e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.187764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.188446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.188735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.189015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.190080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:59.190394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.191826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.200327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 64/125] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.201394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.212978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.214222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.214712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.215188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.216677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.218347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.220766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 62/126] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.221761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.310192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894239e-f9b0-4c9d-954b-240388c6cfdc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.329245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3000-b36b-44f9-b6b9-0ead84c27b7f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.346156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.347036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.347321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.347626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.349791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.351043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.357821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 65/127] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.357821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.373130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.374256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.374744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.375244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.386764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:29:59.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:29:59.396458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:29:59.397233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:29:59.404552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 63/128] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:29:59.405784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.459339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a2160-f23c-4d2b-8667-9fa6c10287d9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.494989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.495717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.496008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.496290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.497511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.499296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.500621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 66/129] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.501366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.512083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d1452-c99e-41c6-82d1-2eeab2940ea2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.547256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.548576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.549070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.549559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/cf223ad1bb814591a9871f0dc159ef4b/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.552256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, user_id=cf223ad1bb814591a9871f0dc159ef4b, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.554050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.573646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 64/130] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:29:59 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/cf223ad1bb814591a9871f0dc159ef4b/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:29:59.575664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.616053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cf8d7-caf9-4b9a-b07d-5f01f8b73e85 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.671410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.673720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.675733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.676068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/ff925927bea446fda1816c4d1ed6afe5/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.682851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, user_id=ff925927bea446fda1816c4d1ed6afe5, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.687665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.720985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 67/131] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:29:59 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/ff925927bea446fda1816c4d1ed6afe5/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:29:59.721863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.742012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5753ea-2752-4a4c-afa4-4f18c3478fb7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.782012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.782710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.783060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.783347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.784215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:29:59.784534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.786058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:29:59.796069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 65/132] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:29:59.803494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:29:59.950958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44578-dcc7-4237-b239-e53a57b586a9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:29:59.993563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:29:59.994654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:29:59.994947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:29:59.995228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:29:59.996550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:29:59.998027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:00.000574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 66/133] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:00.008465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:00.013884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144a82-ffa7-4fde-a1db-862f18f3ddc3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:00.078003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:00.078878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.079166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.079478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.081600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:00.083747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:00.085535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 68/134] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:29:59 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:00.091468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:00.159298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21153df-8dc5-4411-9e65-81f16eadf6c5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:00.203328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:00.204585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.206211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.206705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] PATH_INFO: `/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.211266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] RBAC: Authorizing `identity:get_project(project_id=16c2a6a7627a4172ac5e95fec73b51e1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:00.214180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:00.224007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 67/135] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:00 2022] GET /identity/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:00.232440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27da78-22c7-4be9-99a7-37c9ad782653 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:00.241143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:00.325460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:00.326377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.326675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.326974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/ff925927bea446fda1816c4d1ed6afe5/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.333947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, user_id=ff925927bea446fda1816c4d1ed6afe5, role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:00.335430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36791b6c-0d4d-4328-9311-03eeee5c7c95 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:00.371593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 69/136] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:00 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/ff925927bea446fda1816c4d1ed6afe5/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:00.376756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a1eb0-7807-47a0-81fa-98f954d450fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:00.421778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:00.423112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.423628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.424122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] PATH_INFO: `/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1/users/ff925927bea446fda1816c4d1ed6afe5/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.426450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] RBAC: Authorizing `identity:create_grant(project_id=16c2a6a7627a4172ac5e95fec73b51e1, user_id=ff925927bea446fda1816c4d1ed6afe5, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:00.428546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674d006-edc3-455f-b366-a41e5ae4c331 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:00.450380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 68/137] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:00 2022] PUT /identity/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1/users/ff925927bea446fda1816c4d1ed6afe5/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:30:00.756669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c1b6-d2b7-45df-b681-368e56cdffef None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.757215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c1b6-d2b7-45df-b681-368e56cdffef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.757215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c1b6-d2b7-45df-b681-368e56cdffef None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.758669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 70/138] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:00.764480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:00.764943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:00.765127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:00.788630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:00.789881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:00.869146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 69/139] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:00.918045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c1b6-d2b7-45df-b681-368e56cdffef None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:01.045778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c1b6-d2b7-45df-b681-368e56cdffef None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:01.081070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:01.081872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.082157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.082433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.084224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:01.085687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f44f5-10f2-4d9b-a35b-adc112cc0e57 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:01.087691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 71/140] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:01.092825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:01.131658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989139da-cf7e-41d8-bf75-2cade5ee9d69 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.131954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989139da-cf7e-41d8-bf75-2cade5ee9d69 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.132224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989139da-cf7e-41d8-bf75-2cade5ee9d69 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.133890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 72/141] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:01.139824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.140386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.140887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.166876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:01.170306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:01.270528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ddddb-f167-4407-b772-4951a02596e9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:01.298108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 73/142] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:01.327016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:01.328133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.328676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.329157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.330143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:01.331885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:01.366890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 70/143] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:01 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:01.370761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:01.509309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd3b38-ffe3-421d-8316-5bfd17f660a0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:01.559918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:01.561068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.561552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.562008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.582035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:01.590961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:01.591932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:01.592680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:01.594820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 74/144] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:01.601138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:01.751592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93391-7816-4b69-b28b-f71b7768fbd5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:01.792663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:01.793432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.793634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.793914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:01.794680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:01.794986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:01.796400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:01.805841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 71/145] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:01.812158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:01.955685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a580ca8-7fae-4e91-8140-70ae0bc5c6f8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:01.994850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:01.996040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:01.996474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:01.996915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] PATH_INFO: `/v3/users/94122d34af804458b831e1f50f7a41a4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:02.004088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] RBAC: Authorizing `identity:get_user(user_id=94122d34af804458b831e1f50f7a41a4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:02.006583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:02.008451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 75/146] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:01 2022] GET /identity/v3/users/94122d34af804458b831e1f50f7a41a4 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:02.014137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:02.142488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57b7b2-69a3-4181-8f32-658f683c9d36 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:02.184112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:02.184988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:02.185277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:02.185560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:02.186825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:02.188316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865c10-bfa0-4c31-b20c-8db7f4e8aec2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:02.190325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 72/147] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:02 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:02.196765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:02.341618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19376f5-c900-43e5-875f-08c992d3485f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:02.381952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:02.383230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:02.383763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:02.384284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/94122d34af804458b831e1f50f7a41a4/roles/5a307067f3634dae958211363357844f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:02.386632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, user_id=94122d34af804458b831e1f50f7a41a4, role_id=5a307067f3634dae958211363357844f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:02.388365 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147b3d2-2520-4d48-b23a-912c17ebc2c4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:02.414237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 76/148] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:02 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/users/94122d34af804458b831e1f50f7a41a4/roles/5a307067f3634dae958211363357844f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:03.776200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea575-681b-4d78-8fe3-ac23c4d7e437 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:03.776715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea575-681b-4d78-8fe3-ac23c4d7e437 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:03.776790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bea575-681b-4d78-8fe3-ac23c4d7e437 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:03.778137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 73/149] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:03.784725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5143361-27aa-4753-b6c2-e515f6c868af None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:03.785195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5143361-27aa-4753-b6c2-e515f6c868af None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:03.785374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5143361-27aa-4753-b6c2-e515f6c868af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:03.808749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e5143361-27aa-4753-b6c2-e515f6c868af None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:03.819435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e5143361-27aa-4753-b6c2-e515f6c868af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:03.907428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 77/150] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:03.915729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f26a5-7905-495b-9b30-21e569a1dc2a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:03.916020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f26a5-7905-495b-9b30-21e569a1dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:03.916307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f26a5-7905-495b-9b30-21e569a1dc2a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:03.917689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 74/151] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:03.923283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:03.923604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:03.923904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:03.947406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:03.948623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:04.002225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f26a5-7905-495b-9b30-21e569a1dc2a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.070485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 78/152] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:04.118243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.173370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f26a5-7905-495b-9b30-21e569a1dc2a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.250080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.250893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.251179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.251509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.275612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1dd454fb-b4a6-426e-9898-9f96f09f8722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:04.286698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:04.287946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:04.288723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:04.292083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 75/153] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:04.293458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a12eb-fbbe-46af-8f17-46461012cc72 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.293753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a12eb-fbbe-46af-8f17-46461012cc72 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.294035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a12eb-fbbe-46af-8f17-46461012cc72 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.295595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 76/154] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:04.297808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a12eb-fbbe-46af-8f17-46461012cc72 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.310920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77343a-5ee1-42d6-999d-44079c46214f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.347847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.349565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.350057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.350552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.369587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-4ddad900-0ec4-4824-9d59-b0c4e72cb1bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:04.378389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:04.379286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:04.381269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:04.383969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 79/155] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:04.385604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.386098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.386576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.405055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:04.406667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:04.480107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 80/156] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:04.481418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.529440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a12eb-fbbe-46af-8f17-46461012cc72 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.588676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e959-0e29-40b4-9296-2cc6f4eb11a6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.604337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.604797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.605086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.605367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.606149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:04.606472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:04.607979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:04.617039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 77/157] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:04.617887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.634150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.635207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.635748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.636295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.637319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:04.637831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:04.639534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:04.655328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 81/158] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:04.656605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.759994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2737c4-50d5-46f2-9d97-ed12acdf1c15 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.763610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff07e4f-420c-4db2-8933-a016850f4956 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.799006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.800781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.801004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.801828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.801931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.802214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.802492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.802809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.804476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:04.806237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048911c1-f36b-4bee-bf52-89c9f1495776 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:04.808507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 82/159] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:04.810059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd56ee-0eb2-45a3-a92e-d25f40a010f4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.810558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd56ee-0eb2-45a3-a92e-d25f40a010f4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.811033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd56ee-0eb2-45a3-a92e-d25f40a010f4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.812915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 83/160] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:04.813844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd56ee-0eb2-45a3-a92e-d25f40a010f4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.828685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:04.841944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:04.843016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:04.843902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 78/161] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:04.852343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:04.932525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd56ee-0eb2-45a3-a92e-d25f40a010f4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.970096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:04.971977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.972469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.973070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] PATH_INFO: `/v3/users/cf223ad1bb814591a9871f0dc159ef4b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:04.975820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] RBAC: Authorizing `identity:get_user(user_id=cf223ad1bb814591a9871f0dc159ef4b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:04.977000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7add10f-ca78-4d6b-afb5-887cc6208ca7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:04.977838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f57560-9205-49bf-b409-662f8624c968 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:04.980525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 84/162] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/users/cf223ad1bb814591a9871f0dc159ef4b => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:04.984544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:04.984544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:04.984544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.005926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:05.007506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:05.015294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.016376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.016376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.016567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.086252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.087759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.091290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 85/163] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:05.092489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.212122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4aafc-560d-432c-b332-4623a2117189 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.248109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.249196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.249750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.250226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.251194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:05.251794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.253455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.263012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 86/164] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:05.264225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.290361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 79/165] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:05.291227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.368840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7fbf3-9e0d-4165-9f1c-8119a7e3c6d6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.405422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f0d82-3c74-45d2-a89d-5d0a35fb8b96 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.424822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.425901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.426419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.427466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.440294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.441034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.441317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.441592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.452633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:05.460779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:05.461733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:05.462554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 80/166] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:05.463252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.537784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.543846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.565970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503380-7bc7-4c76-bcd4-42ef07681986 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.602937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.603862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.604148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.604423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.605648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.607103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.608990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 81/167] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:05.609510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.654118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 87/168] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:05.655338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.723686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10acc38-9cd9-4705-b6fb-71c23ea78f42 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.759581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.760474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.760740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.761018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] PATH_INFO: `/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.762257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] RBAC: Authorizing `identity:get_project(project_id=16c2a6a7627a4172ac5e95fec73b51e1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.763755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.765474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 82/169] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/projects/16c2a6a7627a4172ac5e95fec73b51e1 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:05.766252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.767445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6b2a2-8e23-424c-bf1b-ac459956e627 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.804633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.806248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.806781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.807258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.808248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:05.808758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.810388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.819989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 88/170] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:05.821353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:05.884994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25add4b-2c4b-4d7d-8aaa-cebc0f8118f3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.920775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.921129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.921408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.921687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.935649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d0835-f49a-4075-8325-e97a16cba443 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:05.975677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:05.976957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:05.977479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:05.977961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:05.979579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:05.981359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:05.983485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 89/171] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:05.984561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.000828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.002328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.091418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620324-20bc-4dcd-8c32-77f8f6ba01fe None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.102806 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 83/172] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:06.107777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.127062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.128151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.128641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.129119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.130783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=16c2a6a7627a4172ac5e95fec73b51e1, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:06.131327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.133026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.139652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 90/173] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:05 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=16c2a6a7627a4172ac5e95fec73b51e1&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:06.140734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.224602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f122-c23e-449e-966e-f5b932b8653e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.249624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10253e-6219-49fb-9e53-414155f95e09 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.268124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.271460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.275472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.276180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] PATH_INFO: `/v3/users/ff925927bea446fda1816c4d1ed6afe5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.279044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] RBAC: Authorizing `identity:get_user(user_id=ff925927bea446fda1816c4d1ed6afe5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.280799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.285966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 84/174] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/users/ff925927bea446fda1816c4d1ed6afe5 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:06.289561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.309563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.310588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.311094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.311642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.312745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=cf223ad1bb814591a9871f0dc159ef4b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:06.313282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.316252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.330115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 91/175] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/role_assignments?user.id=cf223ad1bb814591a9871f0dc159ef4b&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:06.332528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.461030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1ceeb-61b0-4bcb-ad5d-17a4c73b2652 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.516321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.517146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.517440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.517727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.519262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.521442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.523385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 85/176] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:06.529424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.552100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4c8e7-3e4f-4dd2-9eb9-c7372e8d0e1a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.594628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.595772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.596267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.596749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.679879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.681825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.799253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 92/177] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:06.799440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ff87b-e9c3-4d72-b21c-95b60fc4f094 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:06.807567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:06.852271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:06.852964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:06.853255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:06.853537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:06.854405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:06.854727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:06.856239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:06.872668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 86/178] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:06.975705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5841a0-a5e0-46e7-b65e-2603bdb37f23 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.016987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.017864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.018156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.018439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.024421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:07.025958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1745df-da4e-45da-8b2b-7c21acfd635f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:07.027854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 93/179] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:06 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:07.034136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.088289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbb37-9d80-4f98-8d59-97f062b948a0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.088566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbb37-9d80-4f98-8d59-97f062b948a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.088778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdbb37-9d80-4f98-8d59-97f062b948a0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.090621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 94/180] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:07.099868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618db3de-098b-4eac-aaae-b128e35f969e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.100176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618db3de-098b-4eac-aaae-b128e35f969e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.100478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618db3de-098b-4eac-aaae-b128e35f969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.134106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-618db3de-098b-4eac-aaae-b128e35f969e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:07.135329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-618db3de-098b-4eac-aaae-b128e35f969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:07.212327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc918fe-2761-491b-86f1-27782a0116fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.251616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.252294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.252617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.252839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.253709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=ff925927bea446fda1816c4d1ed6afe5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:07.254025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:07.256985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3331a-ee79-4855-b6b5-cb180dd16fff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:07.264991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 87/181] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/role_assignments?user.id=ff925927bea446fda1816c4d1ed6afe5&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:07.265963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 95/182] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:07.266346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e75fe-2b06-4eee-8fe7-503be17c0158 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.266640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e75fe-2b06-4eee-8fe7-503be17c0158 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.266918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e75fe-2b06-4eee-8fe7-503be17c0158 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.268449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 88/183] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:07.274589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.274918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.275144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.294182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:07.295533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:07.305258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e75fe-2b06-4eee-8fe7-503be17c0158 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.446296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e75fe-2b06-4eee-8fe7-503be17c0158 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.484879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 96/184] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:07.491613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.492579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.492866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.493148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.505572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a5e0ada8-3d9e-49dc-a056-bd93fe25318c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:07.517535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:07.519717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:07.522227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 89/185] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:07.526458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.531064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc6e-8514-402a-911c-00c844581e2d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.531064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc6e-8514-402a-911c-00c844581e2d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.531064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36dc6e-8514-402a-911c-00c844581e2d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.531064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 90/186] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:30:07.537449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36dc6e-8514-402a-911c-00c844581e2d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.669078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36dc6e-8514-402a-911c-00c844581e2d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.680472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4512c3-7334-4d11-935c-ee039d05796f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.703580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.704303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.704579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.704857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.715785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:07.716542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.717229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.717525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.717802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.718575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:07.718902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:07.720329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3d7a7c16-3938-4f83-b0d1-747b66a21a33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:07.723542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:07.724407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:07.725186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 91/187] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:07.728901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.729533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.730004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.731164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 97/188] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:07.731926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.751454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:07.752660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:07.819579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 92/189] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:07.820446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.833578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed5a05-127f-4e45-9a1f-b88f906e76be None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.867807 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.868484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.868766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.869043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.869794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:07.870101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:07.871502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5caf2-fb49-4018-9b34-801838392c87 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 98/190] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a85-5e0d-4fba-a291-468cdd984b31 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a85-5e0d-4fba-a291-468cdd984b31 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee0a85-5e0d-4fba-a291-468cdd984b31 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 99/191] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:07.884381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0a85-5e0d-4fba-a291-468cdd984b31 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.925314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e53f-cfed-4ca6-b1cd-e1a0d40a8234 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:07.962128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:07.962942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:07.963223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:07.963535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:07.978557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:07.980092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:07.981870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 93/192] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:07.982671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:07.988666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee0a85-5e0d-4fba-a291-468cdd984b31 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.024675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.025492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.025786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.026068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.027313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.028833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3d691-02ab-4967-a741-386756e35b53 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.030533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 100/193] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:08.031804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.032100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.032385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.050046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:08.051257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:08.084463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d131cca-c21a-4fb0-9f37-999ebdc982cd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.117178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.118052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.118227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 101/194] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:08.118326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.118596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] PATH_INFO: `/v3/users/94122d34af804458b831e1f50f7a41a4` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.119839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] RBAC: Authorizing `identity:get_user(user_id=94122d34af804458b831e1f50f7a41a4)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.121281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.122888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 94/195] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:07 2022] GET /identity/v3/users/94122d34af804458b831e1f50f7a41a4 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:08.123651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.124247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.221442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5689a2a-9582-4efa-bed5-5c01a0b0d65f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.229639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe202c1-e546-46a4-979c-0f44cfe91444 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.255432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.256121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.256411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.256680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.262784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.263484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.263771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.264050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.264794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.266233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.285131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 95/196] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:08 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:30:08.286596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.333937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.336163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.396905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3510e2-9bdd-4889-be74-b02cebf57fbe None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.433225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.433899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.434185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.434464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.454888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 102/197] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:08.454888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.518008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.520983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.568764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9058-7062-449d-8dd7-e60a7269cc6e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.619515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.620754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.621603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.622070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.636844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:08.644186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 96/198] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:08.645101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:08.647904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:08.648950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:08.649903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:08.652265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 103/199] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:08.653565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.795493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7825a9-cab4-49b8-b106-4f341d7cdb90 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.840066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454b2d4-d288-480e-a7ce-1bdc499b191a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:08.841176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.842223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.842649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.843053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.848253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.850977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.852954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 97/200] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:08.853984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.885477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:08.886433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:08.886719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:08.887046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:08.889415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:08.891137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:08.894696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 104/201] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:08.898198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:08.979629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ce3c-6c88-4c4a-89d5-da14dc9a286a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.006342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a10795-5655-489d-8190-129e1c5c149f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.013742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.014421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.014707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.014981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.015784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:09.016090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.017484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.026612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 98/202] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:09.031904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:09.042312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.042975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.043258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.043581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.044513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e4744cc80b6e45b6b4481994024091d5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:09.044830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.046378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.052495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 105/203] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:08 2022] GET /identity/v3/role_assignments?user.id=e4744cc80b6e45b6b4481994024091d5&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:09.053335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:09.138410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a929250-7e25-4b79-8458-abbcfa799dab None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.165792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c194a9-ba48-4d7c-b498-4c3c7683cba0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.195403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.195403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.195403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.195403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.195811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, scope.project.id=0f2a482b7637419cbec280be7b6207b9, user.id=94122d34af804458b831e1f50f7a41a4) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:09.195811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.203399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.211389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 99/204] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:09 2022] GET /identity/v3/role_assignments?user.id=94122d34af804458b831e1f50f7a41a4&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=5a307067f3634dae958211363357844f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:09.243394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.247420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.247420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.247420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.247420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.250557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.250557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 106/205] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:09 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:09.260729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:09.453970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0c919-282f-4ec4-b736-c53db4ccc6ee None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.503617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.503617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.503617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.503617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.593954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.596020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.698714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 100/206] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:09.704864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:09.831202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832438d-5a19-423f-ab67-250ae04dcc5d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:09.869525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:09.870414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:09.870702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:09.870981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:09.879422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:09.879422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289dfa-0ed0-47ea-a228-641fe04d98e3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:09.880030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 107/207] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:09 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:09.887928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:10.005241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673997e5-512d-419e-b4a5-89c66a49dc90 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:10.043182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:10.044249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:10.044728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:10.045195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:10.046248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e4744cc80b6e45b6b4481994024091d5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:10.046753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:10.048415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9c753-18bd-4859-a9ba-4e9063a7a9e5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:10.054781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 101/208] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:09 2022] GET /identity/v3/role_assignments?user.id=e4744cc80b6e45b6b4481994024091d5&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:10.908333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33932-dbcb-4591-a1c2-ae94794a01ab None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:10.908860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33932-dbcb-4591-a1c2-ae94794a01ab None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:10.909339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f33932-dbcb-4591-a1c2-ae94794a01ab None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:10.912707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 108/209] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:10.921510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768438f-d008-4108-83a5-beb400286e2f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:10.922119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768438f-d008-4108-83a5-beb400286e2f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:10.922119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768438f-d008-4108-83a5-beb400286e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:10.941119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d768438f-d008-4108-83a5-beb400286e2f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:10.942919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d768438f-d008-4108-83a5-beb400286e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:11.013422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 102/210] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:11.041718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33932-dbcb-4591-a1c2-ae94794a01ab None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.113028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e2f5f-489f-4074-b714-d73083658e5f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.113646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e2f5f-489f-4074-b714-d73083658e5f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.114745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e2f5f-489f-4074-b714-d73083658e5f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.116443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 103/211] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:11.122350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.122979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.123507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.142830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:11.146742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:11.160110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f33932-dbcb-4591-a1c2-ae94794a01ab None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.195122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.195959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.196244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.196518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.206991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:11.215885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:11.216839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:11.217623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 109/212] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:11.223488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.229285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 104/213] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:11.256663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.355326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f968810-1229-46f8-b585-058cf4175d26 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.376406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d5f3-ba5c-4e57-b599-592ac198c522 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.399854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.400555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.400847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.401131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.401924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:11.402342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:11.403800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:11.414008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 110/214] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:11.427462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.427653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.427653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.427653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.427653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.427947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:11.427947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:11.429851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 105/215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:11.435655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.552511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9d812-656d-48f3-b362-4550215548ef None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.553140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585d0e3-4afb-4cc6-a569-114ca6726dc2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.591775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.592479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.592881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.595407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.595407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:11.595585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.595972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:11.597418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.600207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.603389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] PATH_INFO: `/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.619390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] RBAC: Authorizing `identity:get_user(user_id=38cbdf99e54f46c9b022a3dea65a9fb8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:11.620995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf9119-56b5-44ac-9903-6a7e98784d97 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:11.621576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 106/216] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:11 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:11.627966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 111/217] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:11.628867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.705734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8f64-a69c-44fb-a746-219286a80cc2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.706229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8f64-a69c-44fb-a746-219286a80cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.706609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c8f64-a69c-44fb-a746-219286a80cc2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.708609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 112/218] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:11.714461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.714753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.715034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.732246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:11.733475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:11.768188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219007e-0fa0-46bc-9f2b-9956fe96b464 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.811880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 113/219] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:11.814651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.819397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.819397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.819397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:11.839401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:11.897713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:11.899137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:11.947293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffbb69-e056-4656-a384-d75e17cb4d76 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:11.991625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:11.992779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:11.993075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:11.993347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.007246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:12.015566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:12.016483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:12.017284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:12.019432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 114/220] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:12.023274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 107/221] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:12.026661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.030485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.150714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0f05c-3829-46c1-9b53-b3e81cc46256 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.172850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629de6d-a0df-4eff-a3f9-ec8a8eae0300 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.191076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.192685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.193169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.193635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.194624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:12.195125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.196747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.211075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 115/222] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:12.212796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.231841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.232753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.233043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.233324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.237510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.239699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.241895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 108/223] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:12.257616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.420178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d8b67-09d4-4d3e-9643-3b55ed556d16 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.448140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d866-9284-460c-b532-2e7cc6771097 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.455399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.456075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.456361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.456642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.458404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=38cbdf99e54f46c9b022a3dea65a9fb8) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:12.458742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.460224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a309c-d8d5-4702-9da4-484d0e622872 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.466414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 109/224] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/role_assignments?user.id=38cbdf99e54f46c9b022a3dea65a9fb8&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:12.467773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c5e9-fd59-4ca8-b7c0-2b399f17e8b2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.468070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c5e9-fd59-4ca8-b7c0-2b399f17e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.468354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c5e9-fd59-4ca8-b7c0-2b399f17e8b2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.469625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 110/225] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:12.475966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.476261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.476535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.494507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:12.499089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:12.514318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.515770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.516255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.516772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.518334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.531392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.534158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 116/226] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:12.540894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.570332 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 111/227] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:12.593251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.708108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44d373-149d-4810-bebe-dabc15384ba5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.750877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.751727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.752022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.752304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.765024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:12.773539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6bfc0-a1c8-49a6-87f3-3fa758250909 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:12.773691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:12.774511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:12.775771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 112/228] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:12.780523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.865759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ea01-df73-4064-9438-55122b870186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.867287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ea01-df73-4064-9438-55122b870186 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.867847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ea01-df73-4064-9438-55122b870186 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.868349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ea01-df73-4064-9438-55122b870186 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.870496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ea01-df73-4064-9438-55122b870186 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.882370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ea01-df73-4064-9438-55122b870186 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.886121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 117/229] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:12.891972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ea01-df73-4064-9438-55122b870186 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:12.896524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633329f0-4dbb-4338-a7a8-29b402def631 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:12.932459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:12.933145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:12.933494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:12.933777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:12.934614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:12.934927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:12.936536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:12.950562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 113/230] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:12.956158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:13.065642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454dfed-6100-4249-9225-9cdee1fecce5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:13.100735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:13.101607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:13.101899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:13.102175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:13.108152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:13.109624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:13.111505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 114/231] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:12 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:13.117058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:13.193592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ea01-df73-4064-9438-55122b870186 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:13.262477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:13.263394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:13.263693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:13.263976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e4744cc80b6e45b6b4481994024091d5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:13.269009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, user_id=e4744cc80b6e45b6b4481994024091d5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:13.270758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:13.302927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdf4f7-945b-48e4-a464-522fc9a2793b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:13.314095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 118/232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:12 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e4744cc80b6e45b6b4481994024091d5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:13.361329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:13.362198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:13.362488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:13.362761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:13.366506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:13.368070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d282e-c6ed-4ea8-b579-a4ac1b04ea53 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:13.370038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 115/233] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:13 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:13.376151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:13.501591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1e22-5222-4632-a473-f7b4ffd52880 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:13.538414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:13.539394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:13.539701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:13.539980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e4744cc80b6e45b6b4481994024091d5/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:13.542344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, user_id=e4744cc80b6e45b6b4481994024091d5, role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:13.543853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174483ea-4a66-4255-ab93-5f1ed2629093 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:13.560053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 119/234] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:13 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e4744cc80b6e45b6b4481994024091d5/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:14.834947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6bcb-3c1f-4f7e-a9d7-26742c3aed6a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:14.834947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6bcb-3c1f-4f7e-a9d7-26742c3aed6a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:14.834947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d6bcb-3c1f-4f7e-a9d7-26742c3aed6a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:14.834947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 116/235] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:14.843389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d3bd-74a5-4855-b5a5-3c2b70d53489 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:14.843389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d3bd-74a5-4855-b5a5-3c2b70d53489 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:14.843389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d3bd-74a5-4855-b5a5-3c2b70d53489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:14.900966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6244d3bd-74a5-4855-b5a5-3c2b70d53489 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:14.903399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6244d3bd-74a5-4855-b5a5-3c2b70d53489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:15.063168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 120/236] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:15.111468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d6bcb-3c1f-4f7e-a9d7-26742c3aed6a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:15.272728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4112a-852b-4909-9124-b262d4c12b4f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.273088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4112a-852b-4909-9124-b262d4c12b4f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.273298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4112a-852b-4909-9124-b262d4c12b4f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.274972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 121/237] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:15.279928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.280219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.280497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.299943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d6bcb-3c1f-4f7e-a9d7-26742c3aed6a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:15.306097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:15.307277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:15.380220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:15.380938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.381228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.381511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.406250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:15.421319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:15.422253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:15.423480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 117/238] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:15.432350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:15.504888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 122/239] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:15.571268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:15.574967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f296-cba0-4946-ac56-d30d25edcf14 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:15.617662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:15.618679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.619163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.619672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.620639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:15.621880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:15.623469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:15.638791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 118/240] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:15.644569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:15.797082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00a915-cfb2-42ed-9de6-cb50194211f7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:15.838961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a48c1-d910-4a0e-a2e2-b67f0b3855cc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:15.875741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:15.877273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.877751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.878214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.880758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:15.882472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:15.888934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 123/241] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:15.893185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:15.924527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:15.925814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:15.926901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:15.927674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] PATH_INFO: `/v3/users/e31d008e1cd34d66b368047b80c55c45` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:15.959342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] RBAC: Authorizing `identity:get_user(user_id=e31d008e1cd34d66b368047b80c55c45)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:15.963632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:15.971436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 119/242] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:15 2022] GET /identity/v3/users/e31d008e1cd34d66b368047b80c55c45 => generated 297 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:15.972576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:16.094153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb36cc6-1c8d-4c37-b2c4-2ef2aea6e665 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.135287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:16.137567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.138074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.139596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.140545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:16.142903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94b9a-16f6-4d5a-87be-b6303c07182e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:16.188991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 124/243] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:15 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:30:16.207819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbc9bb-902e-497f-a0a9-0be024b80f81 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.248182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:16.248882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.249173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.249462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.291716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c262d3-fd64-4c05-b7ea-6b5a8bf54e28 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.292769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c262d3-fd64-4c05-b7ea-6b5a8bf54e28 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.293552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c262d3-fd64-4c05-b7ea-6b5a8bf54e28 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.299390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 125/244] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:16.305120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef195d17-97e9-4320-980d-5eeadb097572 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.305710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef195d17-97e9-4320-980d-5eeadb097572 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.306182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef195d17-97e9-4320-980d-5eeadb097572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.340399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ef195d17-97e9-4320-980d-5eeadb097572 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:16.341991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ef195d17-97e9-4320-980d-5eeadb097572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:16.398455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:16.401584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:16.495608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 126/245] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:16.496964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cc52-d5ee-49a9-8de0-b1a2493bf7ed None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.497254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cc52-d5ee-49a9-8de0-b1a2493bf7ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.497531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509cc52-d5ee-49a9-8de0-b1a2493bf7ed None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.498901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 127/246] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:16.504594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.505322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.505840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.527278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:16.528508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:16.573400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:16.579062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:16.639565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 128/248] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:16.640033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:16.723164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c4193-2ca4-4329-a7f8-69ce450f0b56 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.773031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:16.773805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.774094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.774370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.784306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d469658-2b91-4d1f-b7b1-dcac11690040 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.794658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:16.803356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:16.804330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:16.805128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 121/249] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:16.805769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:16.842958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:16.844559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.845183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.845560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.847575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:16.850417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd7af-cf7f-4b37-8e90-8e8d12d5eebf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:16.855893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 129/250] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:16 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:16.855893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9fc-a6f3-49e2-966f-c67e6d0431c1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.855893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9fc-a6f3-49e2-966f-c67e6d0431c1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.855893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e9fc-a6f3-49e2-966f-c67e6d0431c1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.855893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 130/251] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:16.860075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e9fc-a6f3-49e2-966f-c67e6d0431c1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:16.937889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c621-8624-49b7-bcb3-b261a565d1e6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.975689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:16.976063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:16.976350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:16.976629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:16.991062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:16.993368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e9fc-a6f3-49e2-966f-c67e6d0431c1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:16.998878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:16.999894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:17.000684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:17.005324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 122/252] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:17.006111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.034430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.036091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.036659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.037222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.038187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:17.038749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.040382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a829b-732f-477a-8464-c1b3c3e41937 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.049276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 131/253] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.055873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.056431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.056908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.074164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:17.075747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:17.109850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3fd7-391f-454f-9018-87c2a47f9412 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.144173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.145533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.145798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.146015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.146812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e31d008e1cd34d66b368047b80c55c45) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:17.147125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.148668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.152547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 132/254] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:17.153634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.159420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 123/255] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/role_assignments?user.id=e31d008e1cd34d66b368047b80c55c45&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=5a307067f3634dae958211363357844f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.159420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.324107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612779c-d346-48f4-9f91-60e73b38d5a7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.365743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.366652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.366939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.367216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] PATH_INFO: `/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.368650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] RBAC: Authorizing `identity:get_user(user_id=38cbdf99e54f46c9b022a3dea65a9fb8)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.370167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.372388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 124/256] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.373249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.419128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbd72f-51c9-42c4-8740-ee48d67f908c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.465963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.466640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.466939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.467198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.468010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:17.468354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.470722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.489433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 133/257] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.490683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.524932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dce812-a1a5-4c7e-9958-bcae8529ac50 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.599470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.599470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.599746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.599961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.632323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:17.648809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:17.649748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 125/258] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:17.650949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.663389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d461-94d3-4b6b-9a0e-1106061ca26a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.705395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.706277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.707809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.708164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.710725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.716434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.718297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 134/259] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.719114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.820845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902579-d0fc-4e80-b556-d55a666b00fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.864739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.865670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.865965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.866245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.867597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.869067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.871052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 126/260] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.871922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:17.927796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f173-f01c-433b-a36c-de59492d8e31 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:17.968869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:17.969551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:17.969842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:17.970125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:17.970889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:17.971205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:17.972627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:17.992176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 135/261] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:17.993775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:18.111672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb78c-a421-4444-a46d-bc5adf9cf98b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.160770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.161376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.161667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.161954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.240601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.244021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.247395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5175e0a-60ff-46a4-8476-3c2b31e715dd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.361846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 136/262] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:18.362555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:18.404217 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.405165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.405458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.405739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/38cbdf99e54f46c9b022a3dea65a9fb8/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.412592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, user_id=38cbdf99e54f46c9b022a3dea65a9fb8, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.414009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.453237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 127/263] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:17 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/38cbdf99e54f46c9b022a3dea65a9fb8/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:18.454154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:18.479346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77a4c-4b78-4196-abd1-b9e72924fe48 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.527074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.528043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.528328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.528612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] PATH_INFO: `/v3/users/e4744cc80b6e45b6b4481994024091d5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.530008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] RBAC: Authorizing `identity:get_user(user_id=e4744cc80b6e45b6b4481994024091d5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.536428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.538551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 137/264] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:18 2022] GET /identity/v3/users/e4744cc80b6e45b6b4481994024091d5 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:18.544370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:18.676922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fe1c8-af73-47a7-a7fc-4eeef6be8924 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.720425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.721687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.722174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.722645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.734197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.741445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.743753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 128/265] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:18 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:18.758858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:18.782368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038dd7-23d5-4718-8ac8-c893b49cd350 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.880396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.881093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.881383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.881663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.927941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23850b-193a-4d51-88e5-f40b85f11c9e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:18.980167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:18.981223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:18.981777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:18.982270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:18.983405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e4744cc80b6e45b6b4481994024091d5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:18.983942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.985643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718d057-ed63-4459-967f-b81e523c9419 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.995815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:18.997304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:18.998737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 129/266] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:18 2022] GET /identity/v3/role_assignments?user.id=e4744cc80b6e45b6b4481994024091d5&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:19.105043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d280c-e719-4cd7-af20-1051a41cce3b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.105504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d280c-e719-4cd7-af20-1051a41cce3b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.105884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d280c-e719-4cd7-af20-1051a41cce3b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.107460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 130/267] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:19.116915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.117351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.117733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.152635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:19.154046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:19.214557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 138/268] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 17:30:19.219938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:19.308833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 131/269] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:19.344578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:19.428905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b863254-4aa4-4459-962c-6bb0c87fe265 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:19.482402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:19.483627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.484355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.484809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.486447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:19.488715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d53f3-b683-4222-aab4-682039a4abc5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:19.491731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 139/270] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:19 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:19.493323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e3ad-c2a2-4360-9a9c-f1bf773ca58b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.493851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e3ad-c2a2-4360-9a9c-f1bf773ca58b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.494326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e3ad-c2a2-4360-9a9c-f1bf773ca58b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.496198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 140/271] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:19.498342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8e3ad-c2a2-4360-9a9c-f1bf773ca58b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:19.501517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dab39-ff9e-4a15-947c-831de542e8a1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:19.554154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:19.555911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.556456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.556917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.558765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:19.560418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd8b6b-c8e6-4b31-8b07-6fede9dab427 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:19.563142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 132/272] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:19.565169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.565844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.566461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.590206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:19.591759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:19.632334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8e3ad-c2a2-4360-9a9c-f1bf773ca58b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:19.670547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 133/273] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:19.671746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:19.680626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:19.681483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.681997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.682380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.683836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e4744cc80b6e45b6b4481994024091d5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:19.684264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:19.686489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:19.695406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 141/274] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:19 2022] GET /identity/v3/role_assignments?user.id=e4744cc80b6e45b6b4481994024091d5&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:19.709447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:19.795923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c21ca-6fb1-4bc0-ab7f-d3e9a74f1ed4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:19.867397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:19.867397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.871394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.871394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:19.871394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:19.877452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:19.935754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7d804-8568-4baa-8fb6-3137d6f18e2c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:19.943468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 134/275] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:19 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:30:19.988343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:19.989266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:19.989649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:19.989936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.008878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3f224f69-4b67-4042-bd4b-f6ea98a27f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:20.017296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:20.018275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:20.020467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 142/276] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:20.025946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:20.164068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5028c-9f85-4289-8afb-efe2bbffe4b9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:20.205403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:20.206104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.206393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.206670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.208023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:20.208336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:20.209755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996855-6bbd-480b-aa6c-7da88bb86f85 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:20.225076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00832-08c9-486b-b84a-5f9cc8f3b1e5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.225385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00832-08c9-486b-b84a-5f9cc8f3b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.225558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 135/277] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:20.225709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00832-08c9-486b-b84a-5f9cc8f3b1e5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.227241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 143/278] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:20.232943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.233223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.233503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.235542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e00832-08c9-486b-b84a-5f9cc8f3b1e5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:20.256366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:20.257591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:20.368844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 136/279] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:20.392389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:20.398539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e00832-08c9-486b-b84a-5f9cc8f3b1e5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:20.454714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:20.455495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.455829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.456108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] PATH_INFO: `/v3/users/cc92446a22d04e10b979e267739e1cd0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.475003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cc92446a22d04e10b979e267739e1cd0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:20.476622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:20.480297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 144/280] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/users/cc92446a22d04e10b979e267739e1cd0 => generated 293 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:20.485171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:20.528853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff6572-4cd9-4b83-b232-4a9f2641efa9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:20.579102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:20.580310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.580798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.581290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.596347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:20.606553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:20.607670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:20.608443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:20.611509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 137/281] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:20.618641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1e7d5-f501-42d2-bfd7-7a16cfb583f1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:20.621130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:20.668894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:20.669571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.669918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.670196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.671109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, user.id=cc92446a22d04e10b979e267739e1cd0, scope.system=all) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:20.671484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:20.672994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:20.679739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 145/282] 10.222.0.60 () {56 vars in 1308 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/role_assignments?user.id=cc92446a22d04e10b979e267739e1cd0&scope.system=all&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:20.755885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95a9f9-2b73-4386-9dae-814ca66efa3e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:20.808264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:20.809417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:20.810104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:20.810707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:20.812046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:20.812764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:20.815315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:20.844468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 138/283] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:20.851200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:21.024670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20da5b-bd78-413f-9e7d-0671a02bb53d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:21.071979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:21.072901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.073190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.073472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] PATH_INFO: `/v3/users/e31d008e1cd34d66b368047b80c55c45` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.074894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] RBAC: Authorizing `identity:get_user(user_id=e31d008e1cd34d66b368047b80c55c45)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:21.076532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb7738-cd85-4cd7-86ef-bdc378570216 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:21.078585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 146/284] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:20 2022] GET /identity/v3/users/e31d008e1cd34d66b368047b80c55c45 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:21.085426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:21.214806 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ba73-3d87-4f28-a2df-e5582b4a69ee None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:21.262299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:21.263193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.263512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.263799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.268230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:21.269780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:21.272865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 139/285] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:21 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:21.278676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387bcb-4245-488e-92e4-5fcd62ae46aa None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.278896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387bcb-4245-488e-92e4-5fcd62ae46aa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.279182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387bcb-4245-488e-92e4-5fcd62ae46aa None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.280583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 147/286] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:21.284382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:21.286577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.286872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.287156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.316502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:21.319078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:21.465966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d96adb-a335-4840-a5d5-3e95cd0ce29d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:21.505595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:21.508178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.508525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 148/287] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:21.509022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.509496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e31d008e1cd34d66b368047b80c55c45/roles/5a307067f3634dae958211363357844f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.511840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, user_id=e31d008e1cd34d66b368047b80c55c45, role_id=5a307067f3634dae958211363357844f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:21.513582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:21.534542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:21.555505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 140/288] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:30:21 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/users/e31d008e1cd34d66b368047b80c55c45/roles/5a307067f3634dae958211363357844f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:21.651294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534a05-a3a9-4091-a45a-17e7db0786db None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:21.690528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:21.692372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.692983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.693458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.705560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:21.714154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:21.715052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:21.715878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:21.718379 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 149/289] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:21.724598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:21.902053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc35e3-c12e-429f-929c-e502d2c22f04 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:21.938157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:21.939179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:21.939947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:21.940424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:21.941402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:21.942028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:21.943639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:21.953287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 141/290] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:21.959542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:22.127402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a88e8d-3a76-491d-96ac-5f4f3f5878f7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:22.166877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:22.167791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:22.168081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:22.168355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] PATH_INFO: `/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:22.172084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] RBAC: Authorizing `identity:get_user(user_id=38cbdf99e54f46c9b022a3dea65a9fb8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:22.173551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:22.175530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 150/291] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:21 2022] GET /identity/v3/users/38cbdf99e54f46c9b022a3dea65a9fb8 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:22.181062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:22.299354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab272f-2bc7-4ae1-bb3a-6e1b4fc416af None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:22.337254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:22.338304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:22.338790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:22.339434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:22.419120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:22.421008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:22.525919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 142/292] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:22.540484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:22.711612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57169df9-13c8-4a4e-811c-4c8ac916b549 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:22.777506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:22.778787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:22.779295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:22.779791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:22.781268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:22.782918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7fb8c-7bed-4850-9e28-dced03b1c1f7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:22.789529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 151/293] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:22 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:22.790885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.035384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a576-a223-4368-9128-b92ea1547cb0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.095184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.096265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.096716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.097136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.098849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=38cbdf99e54f46c9b022a3dea65a9fb8) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:23.099323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:23.101133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7aef0-ad62-4fe0-b48b-bab56295f73f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:23.109120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc894f-cdb5-43f3-a97d-17ac34fcb436 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.109433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc894f-cdb5-43f3-a97d-17ac34fcb436 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.110969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc894f-cdb5-43f3-a97d-17ac34fcb436 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.111086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 152/294] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:30:23.115557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 143/295] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:22 2022] GET /identity/v3/role_assignments?user.id=38cbdf99e54f46c9b022a3dea65a9fb8&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:23.133468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.134009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.134009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.159546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0bf4-8139-4e84-ad69-be2811beed47 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.159897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0bf4-8139-4e84-ad69-be2811beed47 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.160115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0bf4-8139-4e84-ad69-be2811beed47 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.162610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 144/296] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:30:23.163047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:23.164504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:23.168486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.169372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.169868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.213196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:23.213196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:23.290626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 145/297] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:23.293234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 153/298] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:23.315298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.332757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.464577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf502ca-55e0-4178-9ca9-580f5e3ecca3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.493226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650b82-e5b8-4911-9a9a-ecb8db0c35ee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.511881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.512932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.512932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.513213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.530506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:23.535814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.539388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.539388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.539388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.539388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:23.539730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:23.540567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:23.541891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:23.542641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:23.542718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 146/299] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:23.545299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 154/300] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:23.546464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.547488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.673647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664727-78ec-4420-a8c5-34992ae158e0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.674981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c158fca-e02b-44cc-8105-01cb31e3fc64 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.713874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.714605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.714896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.715176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] PATH_INFO: `/v3/groups` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.715931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:23.717728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4362ee6-d95d-4aa5-b786-beda605b31a5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:23.719111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.719826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.720118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.720405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.721368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:23.721680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:23.723953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:23.733758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 147/301] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:23.743395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.743563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 155/302] 10.222.0.60 () {60 vars in 1134 bytes} [Tue May 10 17:30:23 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:23.865091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fa6e0-c01b-4350-8f40-524d7defe8ed None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:23.872250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232e10-0f2b-4f9d-8ac8-145e57f8c9cf None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.872250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232e10-0f2b-4f9d-8ac8-145e57f8c9cf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.872250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4232e10-0f2b-4f9d-8ac8-145e57f8c9cf None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.872250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 156/303] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:30:23.877860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.878177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.878450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.896862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:23.898097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:23.907749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:23.909497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:23.909497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:23.909781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] PATH_INFO: `/v3/users/a2a769d09e83451cbf4a63f13f9959f9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:23.931420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] RBAC: Authorizing `identity:get_user(user_id=a2a769d09e83451cbf4a63f13f9959f9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:23.935405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:23.936702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 148/304] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:23 2022] GET /identity/v3/users/a2a769d09e83451cbf4a63f13f9959f9 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:23.943140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:23.985782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 157/305] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:24.008666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.075028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e5810-cbea-49e3-840f-dfa8b87d5adb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.128407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301d6e-a16a-4269-9bd6-72591160c379 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.132772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.133676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.134124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.134540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.135565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, user.id=a2a769d09e83451cbf4a63f13f9959f9, scope.system=all) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:24.136036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:24.138095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:24.146656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 149/306] 10.222.0.60 () {56 vars in 1308 bytes} [Tue May 10 17:30:23 2022] GET /identity/v3/role_assignments?user.id=a2a769d09e83451cbf4a63f13f9959f9&scope.system=all&role.id=5a307067f3634dae958211363357844f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:24.172229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.173781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.174301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.174783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.187982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0c18c4c8-fb81-4ff5-988f-8dfab475840c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:24.197527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:24.198481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:24.199249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:24.202823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 158/307] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:24.209888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.305987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ef93-b799-4a0c-9e77-289050032968 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.306358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ef93-b799-4a0c-9e77-289050032968 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.306550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5ef93-b799-4a0c-9e77-289050032968 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.312671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 159/308] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:24.315463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.315757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.316042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.337019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:24.338247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:24.345682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103769a5-93cc-472d-b5c6-2c4bc8537f8b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.388400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.389013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.389303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.389581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.390350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:24.390659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:24.392071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:24.402134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 150/309] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:24.407684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.435472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 160/310] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:24.460312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.535125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99cbfe-5c22-4eea-bee7-0ecc06ca4983 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.580807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.582670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.582901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd80cad-3c21-4515-a24d-ffbe2f399bbf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.583600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.584076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] PATH_INFO: `/v3/users/cc92446a22d04e10b979e267739e1cd0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.586500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] RBAC: Authorizing `identity:get_user(user_id=cc92446a22d04e10b979e267739e1cd0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:24.588315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:24.590705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 151/311] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/users/cc92446a22d04e10b979e267739e1cd0 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:24.595828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.623498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.624671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.625169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.625639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.636631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:24.645322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:24.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:24.647171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:24.654465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 161/312] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:24.656117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.719165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74379bd-109b-4222-b214-f36fccb21954 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.761905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.762447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254471f3-4783-4741-8a5a-7118ca84fa7f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:24.762774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.763058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.763462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] PATH_INFO: `/v3/system/users/cc92446a22d04e10b979e267739e1cd0/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.766270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cc92446a22d04e10b979e267739e1cd0, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:24.768176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:24.783447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 152/313] 10.222.0.60 () {58 vars in 1334 bytes} [Tue May 10 17:30:24 2022] PUT /identity/v3/system/users/cc92446a22d04e10b979e267739e1cd0/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:24.809744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:24.810827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:24.811312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:24.811839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:24.812797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:24.813406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:24.815304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:24.830405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 162/314] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:24.832149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:24.956789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cb83-3efe-4c32-930c-8cc2a428521b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:25.004020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:25.004020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:25.004020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:25.004020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] PATH_INFO: `/v3/users/e31d008e1cd34d66b368047b80c55c45` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:25.004475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] RBAC: Authorizing `identity:get_user(user_id=e31d008e1cd34d66b368047b80c55c45)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:25.004475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:25.006474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 153/315] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:24 2022] GET /identity/v3/users/e31d008e1cd34d66b368047b80c55c45 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:25.014582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:25.127393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c487b4-f007-49d2-81ca-810ed06217ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:25.161694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:25.161694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:25.161694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:25.161694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:25.232526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:25.234770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:25.339517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 163/316] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:25.345142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:25.463501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c32-8bc3-4ad0-856a-0e7a486c66d6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:25.498680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:25.500015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:25.500508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:25.500983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:25.502386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:25.504120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b287c4-f892-4e54-b7f6-69da800b8c94 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:25.506430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 154/317] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:25 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:25.512157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:25.613574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9954-cfb5-48fa-8a8d-e56bde1f8bcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:25.648302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:25.649365 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:25.649868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:25.650327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:25.651398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41, user.id=e31d008e1cd34d66b368047b80c55c45) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:25.651919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:25.653575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf78a4-9390-4e72-8f35-a32d94df09bd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:25.660495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 164/318] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:30:25 2022] GET /identity/v3/role_assignments?user.id=e31d008e1cd34d66b368047b80c55c45&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=5a307067f3634dae958211363357844f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:26.195141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd51ed-0339-4f54-b646-9dfd0fb4d0b3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.195692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd51ed-0339-4f54-b646-9dfd0fb4d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.195770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd51ed-0339-4f54-b646-9dfd0fb4d0b3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.197115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 155/319] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:26.202706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86951-b6a7-44f8-8e12-db57a899ef5e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.203005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86951-b6a7-44f8-8e12-db57a899ef5e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.203288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da86951-b6a7-44f8-8e12-db57a899ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.220521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3da86951-b6a7-44f8-8e12-db57a899ef5e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:26.221726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3da86951-b6a7-44f8-8e12-db57a899ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:26.291265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 165/320] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:26.315263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd51ed-0339-4f54-b646-9dfd0fb4d0b3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:26.429914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd51ed-0339-4f54-b646-9dfd0fb4d0b3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:26.472658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f806-b1f2-445d-a987-be7dda71fdbc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.472933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f806-b1f2-445d-a987-be7dda71fdbc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.473527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42f806-b1f2-445d-a987-be7dda71fdbc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.473869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:26.474735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 166/321] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:26.474835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.474974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.475257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.476739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:26.478211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:26.480045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 156/322] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:26.480424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.480722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.481070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.485596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:26.498840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:26.500069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:26.575544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 167/323] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:26.596277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:26.598671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62194a41-1151-43bc-80ba-723320539cf9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:26.634268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:26.635121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.635439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.635719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] PATH_INFO: `/v3/groups` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.636429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:26.637893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:26.655463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 157/324] 10.222.0.60 () {60 vars in 1134 bytes} [Tue May 10 17:30:26 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:26.715329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642a3b-66c1-4017-b24b-9b93919c801c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:26.753015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:26.753736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.754700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.754974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.766708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:26.775627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:26.776569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:26.777360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:26.778646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 168/325] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:26.783394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:26.891013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc23b5-6fa9-4f37-b644-40538ac56ce8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:26.931065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:26.932182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:26.932686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:26.933406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:26.934763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:26.935286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:26.937880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6e423-4690-4aa2-848c-5525fc5ceb5c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:26.953692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 158/326] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:26.962915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:27.131498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2791ce-4b13-4806-a00e-1f363e85044a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:27.186520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:27.187941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.188476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.188969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] PATH_INFO: `/v3/users/a2a769d09e83451cbf4a63f13f9959f9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.191054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a769d09e83451cbf4a63f13f9959f9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:27.193841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:27.196895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 169/327] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:26 2022] GET /identity/v3/users/a2a769d09e83451cbf4a63f13f9959f9 => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:27.197270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a609-33ab-4c63-83ab-a6ea7c65f4f1 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.197721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a609-33ab-4c63-83ab-a6ea7c65f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.197885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75a609-33ab-4c63-83ab-a6ea7c65f4f1 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.199321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 159/328] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:27.204152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:27.209382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.209961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.210513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.253393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:27.255833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:27.345298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c38101-4840-4f7d-9188-2ac9cde07063 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:27.374605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 160/329] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:27.391425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:27.392882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.393511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.393955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] PATH_INFO: `/v3/system/users/a2a769d09e83451cbf4a63f13f9959f9/roles/5a307067f3634dae958211363357844f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.396516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2a769d09e83451cbf4a63f13f9959f9, role_id=5a307067f3634dae958211363357844f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:27.398230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:27.413276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 170/330] 10.222.0.60 () {58 vars in 1334 bytes} [Tue May 10 17:30:27 2022] PUT /identity/v3/system/users/a2a769d09e83451cbf4a63f13f9959f9/roles/5a307067f3634dae958211363357844f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:27.415708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:27.570583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e78c-7bf2-4449-9dd8-232563c1059d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:27.624251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:27.625338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.625750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.626210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.644713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:27.655257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:27.656379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:27.657187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:27.659771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 161/331] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:27.672299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:27.825718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc105c5e-7205-4a79-ae04-23b094b55d19 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:27.879720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:27.880427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:27.880712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:27.880991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:27.881774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:27.882085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:27.883623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:27.897084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 171/332] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:27.902720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:28.040389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4fe77-889d-48d5-921d-742a2f387b1b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:28.084862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:28.085763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:28.086050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:28.086327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] PATH_INFO: `/v3/users/cc92446a22d04e10b979e267739e1cd0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:28.087892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] RBAC: Authorizing `identity:get_user(user_id=cc92446a22d04e10b979e267739e1cd0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:28.089366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f70c1-259d-47f5-a68e-7be4df2bf775 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:28.091460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 162/333] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:27 2022] GET /identity/v3/users/cc92446a22d04e10b979e267739e1cd0 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:28.100557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:28.283396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25db5e9-a470-4035-bc5c-555cd0bf71fb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:28.338564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:28.339259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:28.339580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:28.339869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:28.340797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] RBAC: Adding query filter params (role.id=c8cdd31ae58f4093a5a43e750e395e36, user.id=cc92446a22d04e10b979e267739e1cd0, scope.system=all) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:28.341128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:28.342649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f2dfa-81dd-4b3c-9f10-464f0fb30204 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:28.357893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 172/334] 10.222.0.60 () {56 vars in 1308 bytes} [Tue May 10 17:30:28 2022] GET /identity/v3/role_assignments?user.id=cc92446a22d04e10b979e267739e1cd0&scope.system=all&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 510 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:29.510838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3e6f-edcd-4d66-8a04-ee027e9cfabc None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:29.511395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3e6f-edcd-4d66-8a04-ee027e9cfabc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:29.511479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3e6f-edcd-4d66-8a04-ee027e9cfabc None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:29.514329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 163/335] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:29.521439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:29.521928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:29.522031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:29.556423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:29.557656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:29.674032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 173/336] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:29.714437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3e6f-edcd-4d66-8a04-ee027e9cfabc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:29.861711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3e6f-edcd-4d66-8a04-ee027e9cfabc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:29.912187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:29.913018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:29.913310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:29.913591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:29.932177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:29.940593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:29.942301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:29.943080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:29.947513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 164/337] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:29.950898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:30.111479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41f565-e7aa-4a21-87ac-0eb00ceed2ea None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:30.163391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:30.163391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.163391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.163391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.163794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:30.163794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:30.164123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:30.179299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 174/338] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:30.183947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:30.367644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5755-29da-4fc1-88ff-01b514596338 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:30.411393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:30.411393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.411393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.411393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.494415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:30.496052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43382486-2630-4b17-95ea-ef5d83eeb46f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:30.602422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 165/339] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:30.613699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:30.769252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc56d-721c-4310-99bf-4b55e5adb8ee None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.775388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc56d-721c-4310-99bf-4b55e5adb8ee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.775388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc56d-721c-4310-99bf-4b55e5adb8ee None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.775388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 166/340] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:30.787356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07587932-2284-4a39-b5b4-9b15042b1889 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:30.792194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9022ed-5f19-4cb4-8566-926abbe6722f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.792507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9022ed-5f19-4cb4-8566-926abbe6722f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.792789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9022ed-5f19-4cb4-8566-926abbe6722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.838023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3c9022ed-5f19-4cb4-8566-926abbe6722f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:30.840061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3c9022ed-5f19-4cb4-8566-926abbe6722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:30.845438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:30.847421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.847421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.847421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:30.849647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:30.855579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 175/341] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:30 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:30.858235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:30.922619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 167/342] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:30.924406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5417-1ae4-4607-82a8-c93fb89c3d1b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.924906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5417-1ae4-4607-82a8-c93fb89c3d1b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.925419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5417-1ae4-4607-82a8-c93fb89c3d1b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.927842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 168/343] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:30.936786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:30.937375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:30.937886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:30.964193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:30.966755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:31.044197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 169/344] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:31.045376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.095484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191b0f0-8055-46c9-b61a-5703ed90d295 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.154323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93532de4-8945-4aed-aa82-2e7a96267961 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.170945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.171824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.172109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.172389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.185841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:31.188613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:31.199354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 176/345] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:30 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:31.200294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.209733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.210925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.211445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.211927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.233539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:31.249493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:31.250423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:31.251219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:31.253770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 170/346] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:31.255606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.323486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953c6a-15fb-49d6-8c36-0e67d18f650f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.368924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.370252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.370252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.370421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.393850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:31.408511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:31.409477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:31.410338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 177/347] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:31.412739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71366c4-1ac3-4dce-96b0-498474ed6c90 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.415228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.470631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.471804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.472326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.472856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.474092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=0f2a482b7637419cbec280be7b6207b9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:31.474616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:31.476339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:31.486915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 171/348] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:31.488652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.595993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee78d-be28-467d-9f71-0030f1269fff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.660773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.661594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.661767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.662029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.662815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:31.663126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:31.664563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:31.674098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 178/349] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:31.680473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.688878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c422eb-d9aa-42f0-a866-64d62e5d53e0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.761728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.766050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.766050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.766050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:31.771400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:31.771400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:31.771400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:31.787297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 172/350] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:31.809989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:31.907096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab772f-d42b-4cfb-bec0-ed8177e60df5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:31.972275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:31.972275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:31.973180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:31.973463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.012588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5b57c-e050-41e7-abcd-21fac2e313b0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.067822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.069369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a013d-554c-49cf-b7d3-5fa227816af2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.081583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.083017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.083330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.083651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.190846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 179/351] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:32.194213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803af91-331a-4263-8392-f4c120874d7f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.194804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803af91-331a-4263-8392-f4c120874d7f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.195304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803af91-331a-4263-8392-f4c120874d7f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.197289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 180/352] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:32.203358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803af91-331a-4263-8392-f4c120874d7f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:32.212715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.214215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d47e36-9ea8-4f1b-a051-8d5e2151d3de None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.336087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803af91-331a-4263-8392-f4c120874d7f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.411863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 173/353] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:32.413597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.416477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.416886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.417392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.417899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.418386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.418861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.421686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.424154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.433148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 181/354] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:32.434456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:32.460223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:32.461790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:32.552488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 174/355] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:32.552808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:32.616967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41ff8-296c-4a9d-b9f9-de4721e9aa2f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.656682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.657563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.657842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.658128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.663391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.663391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd646c21-a3d1-4a75-8957-72b7149b5a11 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.664025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 182/356] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:32.671389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c64f-cedb-4324-9b30-5e01b6e0ab17 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.671573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e99c-666e-40f2-84da-995de1e1e9c2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.671573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e99c-666e-40f2-84da-995de1e1e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.671573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e99c-666e-40f2-84da-995de1e1e9c2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.671573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 183/357] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:32.675060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e99c-666e-40f2-84da-995de1e1e9c2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:32.712569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.714065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.714496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.714915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.716360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.719873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.722104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 175/358] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:32.723954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:32.807159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e99c-666e-40f2-84da-995de1e1e9c2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.860335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.861532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.861890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.862359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.883753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-61fa80ff-2e63-4f0e-bb2f-087f5dc4fa54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:32.892993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:32.893970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 17:30:32.894802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:32.895436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109ae2f-aca9-479b-a2e6-aa3ea04867af None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:32.895514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 184/359] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:32.896580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ed77-5cc6-4c9a-a3e0-a2edbc5b0aea None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.897160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ed77-5cc6-4c9a-a3e0-a2edbc5b0aea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.897160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ed77-5cc6-4c9a-a3e0-a2edbc5b0aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.924765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ee04ed77-5cc6-4c9a-a3e0-a2edbc5b0aea None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:32.928149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ee04ed77-5cc6-4c9a-a3e0-a2edbc5b0aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:32.945382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:32.946282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:32.946573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:32.946856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:32.948306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:32.949565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:32.951449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 176/360] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:32.958204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.029723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 185/361] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:33.031425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a43b4-dee2-4b58-ab40-89522e3010d4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.031963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a43b4-dee2-4b58-ab40-89522e3010d4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.032459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a43b4-dee2-4b58-ab40-89522e3010d4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.034012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 186/362] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:33.035507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a43b4-dee2-4b58-ab40-89522e3010d4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.091416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084dba5-110c-47ee-9657-b2f7fc39a72b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.131960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.131960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.131960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.131960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.132363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:33.132363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:33.133664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:33.139530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 177/363] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:32 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:33.140459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.180619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a43b4-dee2-4b58-ab40-89522e3010d4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.223067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.223298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.223597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.223883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.228249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:33.228249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:33.235397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403378-af7b-4c3c-95f4-1a2140ba3dca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:33.246555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 187/364] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:33.250039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.250039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.250039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.272607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:33.273863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:33.274152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68df2a-a82c-42be-a09a-1a7953ac3ee6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.327847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.328475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.328768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.329053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.330560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=0f2a482b7637419cbec280be7b6207b9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:33.333153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:33.335357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:33.342940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 178/365] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:33.348978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.399610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 188/366] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:33.400627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.558628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49022bd9-c765-46e6-83d5-40966c952fdf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.562176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d2301-18a5-4d51-9e74-f4f3d881a95f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.636058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.636790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.637076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.637357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.640657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.643344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.645206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.645206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] PATH_INFO: `/v3/users/a2a769d09e83451cbf4a63f13f9959f9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.646977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a769d09e83451cbf4a63f13f9959f9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:33.651419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:33.655393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 189/367] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/users/a2a769d09e83451cbf4a63f13f9959f9 => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:33.655393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.669957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:33.681612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:33.682591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:33.683421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:33.688877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 179/368] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:33.690047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.846617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9796ee0-9c37-4495-927b-811375f8f333 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.886758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.886963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5529-f556-4fc7-8212-50d34ad21726 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:33.888240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.888901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.893476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.906173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:33.918667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:33.919750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:33.920527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:33.922455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 190/369] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:33.923635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:33.990779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:33.991757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:33.992233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:33.992672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:33.993823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] RBAC: Adding query filter params (role.id=5a307067f3634dae958211363357844f, user.id=a2a769d09e83451cbf4a63f13f9959f9, scope.system=all) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:33.994286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:33.996015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:34.037680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 180/370] 10.222.0.60 () {56 vars in 1308 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/role_assignments?user.id=a2a769d09e83451cbf4a63f13f9959f9&scope.system=all&role.id=5a307067f3634dae958211363357844f => generated 510 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:34.038762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:34.042922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166946c-a50f-4ae8-9b65-dcfad75f0c75 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:34.090023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:34.090518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:34.090810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:34.091090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:34.092161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:34.092485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:34.094096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:34.104720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 191/371] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:34.112007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:34.276125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82981d1-89f9-4752-862d-a05f269feb0a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:34.340005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cc4e5-32be-4bac-8aad-68e0369b47e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:34.368532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:34.369064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:34.369384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:34.369629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:34.370398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:34.370707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:34.372114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:34.390940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 181/372] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:34.400271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:34.415375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:34.415375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:34.421652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:34.421989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:34.559465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:34.560916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:34.611627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd9f20-2513-4e56-b05d-b21ef51fd99c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:34.672236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:34.672920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:34.673214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:34.673527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:34.752002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:34.754124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:34.763532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 192/373] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:34.778003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:34.887283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 182/374] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:34.894047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:34.971960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da7222-2ee0-4531-b570-08e2b33ebee0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.019186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec718e2-181f-4eb1-8c40-a0d80a479a8b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.037676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.039063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.040446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.045782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.047411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.049600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 193/375] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:34 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:35.061920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:35.071397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.071397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.071397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.071397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] PATH_INFO: `/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.071803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] RBAC: Authorizing `identity:get_project(project_id=05b43e5ee8d94e7eabaa576aaa97efc1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.072522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.079155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 183/376] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:34 2022] GET /identity/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:35.081064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:35.201438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744533-702d-4e70-a21b-1f5e3bc65c2f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.252809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.254324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.254635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.254991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] PATH_INFO: `/v3/groups/b6a66ba42ed0489686d4796785020ecd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.259400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7c07-ca39-4898-8c11-1b2f30814809 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.262951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] RBAC: Authorizing `identity:get_group(group_id=b6a66ba42ed0489686d4796785020ecd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.264550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83188106-25c6-4bc2-a4e6-d10584b515ff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.279288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 184/377] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/groups/b6a66ba42ed0489686d4796785020ecd => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:35.279288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1727-13b6-4866-a790-357b2399a282 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.279288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1727-13b6-4866-a790-357b2399a282 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.279288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1727-13b6-4866-a790-357b2399a282 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.279723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 185/378] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:35.283408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1727-13b6-4866-a790-357b2399a282 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:35.299297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.300493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.300630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.302010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.305620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.305620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb869f9a-2326-49f0-adfd-a3d5ecc90730 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.311402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 194/379] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:35.311402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.311402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.311402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.335099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:35.336724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:35.418595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1727-13b6-4866-a790-357b2399a282 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.420911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 195/380] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:35.432250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:35.475468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.475468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.475468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.475795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.478361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] RBAC: Adding query filter params (group.id=b6a66ba42ed0489686d4796785020ecd, role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=05b43e5ee8d94e7eabaa576aaa97efc1) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:35.478691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.480389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.495544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 186/381] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/role_assignments?group.id=b6a66ba42ed0489686d4796785020ecd&scope.project.id=05b43e5ee8d94e7eabaa576aaa97efc1&role.id=0d49494e76f84242bc3076803ab15e82 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:35.498020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:35.577961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0882a-9069-41f7-87fb-4bf29ec97d87 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.627121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.630517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.631140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.631660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.632787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:35.633402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:35.635125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:35.643350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 196/382] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:35.693153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc43e2-a52f-455c-a8d9-7d83b77f462f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:35.759428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:35.760163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:35.760445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:35.760715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:35.780061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:35.794732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:35.795822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:35.797127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:35.800996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 187/383] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:35.813089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:36.086277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc29534-fa5c-4816-9bb4-0509edc78a13 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:36.159402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:36.159402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:36.159402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:36.159402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:36.161627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:36.162207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:36.164918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:36.186101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 197/384] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:36.201147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:36.526696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78ec9b-deda-447e-becf-2e3b0c0593a5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:36.589413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:36.590309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:36.590597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:36.590876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:36.596255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:36.598330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0e5f0-a52d-4cb6-9927-5ea933a6aa64 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:36.600470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 188/385] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:36 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:36.609110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:36.734625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8572b8-2b16-49dd-949e-432381e7c575 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:36.734984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8572b8-2b16-49dd-949e-432381e7c575 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:36.735235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8572b8-2b16-49dd-949e-432381e7c575 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:36.737139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 189/386] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:36.752978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:36.754274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:36.754765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:36.788696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:36.789840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:36.881927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb141-6b89-4cbb-b4e8-9bc3e496968c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:36.916389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 190/387] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:36.948370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:36.977073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:36.978633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:36.979124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:36.979919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:36.982386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:36.985584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:36.997891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 198/388] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:36 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:37.008314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:37.085694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27e4b-7bfd-425d-bdf6-7cd58fcba17f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:37.128326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:37.130280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.130845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.131343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.156750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:37.170483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:37.171529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:37.172317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:37.179898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 191/389] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:37.185568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:37.273831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca49a5-4c58-4ad1-8018-6baa91c8b429 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:37.346061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:37.347667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.348194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.348691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.356513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, group_id=dfd915b36c9d4b25be6d6bfe837a0e64, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:37.359304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca159c3-eb97-43d3-b502-895fb5442c3b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:37.406468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 199/390] 10.222.0.60 () {58 vars in 1442 bytes} [Tue May 10 17:30:37 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:37.463005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7235-e65a-42db-9afe-b60359f6f0f8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.463860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7235-e65a-42db-9afe-b60359f6f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.464619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc7235-e65a-42db-9afe-b60359f6f0f8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.468015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 200/391] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:37.475279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.476440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.477252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.535498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:37.540812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:37.576003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748b1c-9f6a-4654-93d3-76cf1c72c402 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:37.700075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 201/392] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:37.718183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:37.719213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:37.720068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.720906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.721753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.724420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:37.725378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:37.730245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:37.759647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 192/393] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:37.766946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:37.910696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b332-c4ca-49b9-9083-d95c816f5315 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:37.949804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:37.950680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:37.950953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:37.951216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:37.970405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:37.980829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:37.981782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:37.982579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:37.989933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 202/394] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:37.991653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:37.997449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6bf7f-dd2e-4aa8-a207-d58b7448bfd2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.075014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.077195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.080552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.081396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.084403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.087795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.091972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 193/395] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:37 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:38.101184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:38.169684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc5fd-9afc-4301-9c38-65bafea6c599 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.250985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.251953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.252380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.252824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.254817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:38.260043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.262894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.291539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 203/396] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:38.299252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:38.341955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff271ed-fabb-4504-8ddd-95f0aad6047f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.443351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.445402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.446216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.446954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.453682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.458383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.462480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 194/397] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:38 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:38.476425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:38.573593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c6dd-f96c-480f-95c1-1b25a11669a6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.617279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd76fa-7973-4e7d-a4dc-05911bd3dfa0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.668777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.671048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.672057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.672821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.681547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2a482b7637419cbec280be7b6207b9, group_id=dfd915b36c9d4b25be6d6bfe837a0e64, role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.684805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.687466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.689520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.692487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.695181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.699343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.704878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.711127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 204/398] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:38 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:38.728313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:38.737012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 195/399] 10.222.0.60 () {58 vars in 1442 bytes} [Tue May 10 17:30:38 2022] PUT /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:38.875560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d37ea-6f4e-44ca-b072-6676011e1486 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:38.920309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:38.921685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:38.922254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:38.923019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:38.924818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:38.926794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07ee5-e59a-49b8-b90e-7e5ce6486aee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:38.929435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 205/400] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:38 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:38.936796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:39.178256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29938da-2259-4ce3-ba4f-83ce074d8ae3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:39.254246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:39.256843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:39.257711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:39.258533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:39.263260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, group_id=dfd915b36c9d4b25be6d6bfe837a0e64, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:39.266384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379585b-4e64-42a7-99be-d143281d0810 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:39.309916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 196/401] 10.222.0.60 () {58 vars in 1442 bytes} [Tue May 10 17:30:38 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:30:39.506928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e73-845b-4df3-8818-9830ae5d4a3a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:39.507715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e73-845b-4df3-8818-9830ae5d4a3a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:39.507715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e73-845b-4df3-8818-9830ae5d4a3a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:39.508841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 206/402] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:39.520232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2a2f-f10d-49b7-a5e1-210ab70fc639 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:39.520591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2a2f-f10d-49b7-a5e1-210ab70fc639 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:39.520808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab2a2f-f10d-49b7-a5e1-210ab70fc639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:39.545725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-18ab2a2f-f10d-49b7-a5e1-210ab70fc639 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:39.548539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-18ab2a2f-f10d-49b7-a5e1-210ab70fc639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:39.682947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 197/403] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:39.709688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222e73-845b-4df3-8818-9830ae5d4a3a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:39.749336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf2be-a766-49e1-b624-fb3d607a903b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:39.749737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf2be-a766-49e1-b624-fb3d607a903b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:39.749984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf2be-a766-49e1-b624-fb3d607a903b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:39.751789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 198/404] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:39.759848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:39.760072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:39.760373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:39.782458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:39.783710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:39.888763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 199/405] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:39.913185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:40.029743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d6191-4bb2-4b6e-898f-56c5a0ccc364 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:40.070197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:40.071262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:40.071747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:40.072200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:40.096443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:40.104441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222e73-845b-4df3-8818-9830ae5d4a3a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:40.118025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:40.119385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:40.120243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:40.125114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 200/406] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:40.133892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:40.193776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:40.194993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:40.195638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:40.196308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:40.227086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:40.242706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:40.243730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:40.244554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:40.255967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 207/407] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 547 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:40.268299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:40.372658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb3a99-1b8b-4bf8-a8cf-03952d80ba50 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:40.443008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:40.444950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:40.445510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:40.445997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:40.447010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:40.447603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:40.454609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:40.470496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 201/408] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:40.481024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:40.546849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af735-1d0a-4291-a3bf-72611a16edde None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:40.686462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:40.687611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:40.688095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:40.688587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:40.690183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:40.690704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:40.693340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:40.727682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 208/409] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:40.746332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:40.786939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e70fe-a7e2-4ec5-a2eb-402c38ef813a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:40.840533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:40.842769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:40.844441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:40.845136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:40.850249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:40.853597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:40.858654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 202/410] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:40 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:40.870751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:41.083762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d6d26-0cbb-4cec-8cca-ef191de75921 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:41.126751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:41.127965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.129409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.130084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.131682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:41.133364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:41.135700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 203/411] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:40 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:41.141684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:41.256469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662f7d0-4b16-4496-aad5-5997c0034e3f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:41.264358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50ae9a-ecf4-483d-9968-56fe2f56b8e1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:41.318866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:41.320246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.320768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.321262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.323802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b071a7a3b0741a084d4c1a568c6dd41, group_id=dfd915b36c9d4b25be6d6bfe837a0e64, role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:41.325479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:41.348040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224e40-05da-481b-8458-86db245c5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:41.350752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224e40-05da-481b-8458-86db245c5644 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.351258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224e40-05da-481b-8458-86db245c5644 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.351781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224e40-05da-481b-8458-86db245c5644 None admin] PATH_INFO: `/v3/groups/b6a66ba42ed0489686d4796785020ecd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.353553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224e40-05da-481b-8458-86db245c5644 None admin] RBAC: Authorizing `identity:get_group(group_id=b6a66ba42ed0489686d4796785020ecd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:41.358053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224e40-05da-481b-8458-86db245c5644 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:41.359081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 209/412] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:40 2022] GET /identity/v3/groups/b6a66ba42ed0489686d4796785020ecd => generated 229 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:41.365328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224e40-05da-481b-8458-86db245c5644 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:41.371990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 204/413] 10.222.0.60 () {58 vars in 1442 bytes} [Tue May 10 17:30:41 2022] PUT /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41/groups/dfd915b36c9d4b25be6d6bfe837a0e64/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:30:41.568140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224e40-05da-481b-8458-86db245c5644 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:41.635756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:41.636760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.637076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.637444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] PATH_INFO: `/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.638799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] RBAC: Authorizing `identity:get_project(project_id=05b43e5ee8d94e7eabaa576aaa97efc1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:41.640712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ffcf47-9901-4696-bece-f854c931c80a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:41.651397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 210/414] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:41 2022] GET /identity/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1 => generated 344 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:41.654402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:41.841162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae22a6d-3819-4c5c-9571-aab9bd5d0ef9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:41.886176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:41.887646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.888147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.888649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] PATH_INFO: `/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1/groups/b6a66ba42ed0489686d4796785020ecd/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.893412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=05b43e5ee8d94e7eabaa576aaa97efc1, group_id=b6a66ba42ed0489686d4796785020ecd, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:41.896297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:41.900834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae03c-0faf-42da-9ec0-41c56cac98fa None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.901810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae03c-0faf-42da-9ec0-41c56cac98fa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.902575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae03c-0faf-42da-9ec0-41c56cac98fa None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.913559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 211/415] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:41.918764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:41.920170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:41.921013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:41.939585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 205/416] 10.222.0.60 () {58 vars in 1442 bytes} [Tue May 10 17:30:41 2022] PUT /identity/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1/groups/b6a66ba42ed0489686d4796785020ecd/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:30:41.961112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:41.962906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:42.074329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 212/417] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:42.141776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:42.392085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3bfd3-84c1-4b1c-9c67-e352b4b84ca4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:42.465476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:42.466888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:42.467420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:42.467913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:42.484704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e291299b-e113-434d-aad1-cc00f4153e57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:42.494149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:42.495250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:42.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:42.499167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 206/418] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:42.511116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:42.589765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e51a-dfcf-4659-8e0f-6508311710e9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:42.590111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e51a-dfcf-4659-8e0f-6508311710e9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:42.590378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e51a-dfcf-4659-8e0f-6508311710e9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:42.592035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 207/419] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:42.599906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:42.600200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:42.600525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:42.668425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:42.669952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:42.777459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb9d2-a6ba-425b-9f07-a83e8028305a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:42.868317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:42.869434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:42.869930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:42.870421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:42.873877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:42.874240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:42.876955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:42.911048 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 213/420] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:42.916750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:42.966840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 208/421] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:43.004103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:43.214719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea797-222b-4ee8-8d9a-dc1c54dd6db9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:43.263495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:43.271471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:43.272317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:43.272776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:43.283236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57949-dd2f-4dc0-a138-ee347cd8b950 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:43.290879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:43.301199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:43.302173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:43.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:43.306310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 209/422] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:43.328623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:43.426930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:43.428173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:43.428660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:43.429139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:43.635881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:43.639263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:43.786204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 214/423] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:43.795727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:43.841495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c33af-a855-414d-bdfc-6f6b7dca361e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:43.927550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:43.928654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:43.929160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:43.929656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:43.930657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:43.931175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:43.932821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:43.961514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 210/424] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 634 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:43.972995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:43.994106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa36f-7ce2-46d8-ad59-a5849768dd70 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.078209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.080730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.082419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.083097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.087279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:44.094339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f901ae4-f0db-491f-8594-c9f4b2479087 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:44.100728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 215/425] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:43 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:44.103089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd9bf-84ae-42ac-8c04-0a52d2253b5f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.105323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd9bf-84ae-42ac-8c04-0a52d2253b5f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.106112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd9bf-84ae-42ac-8c04-0a52d2253b5f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.111274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 216/426] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:44.113205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd9bf-84ae-42ac-8c04-0a52d2253b5f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:44.135331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9739e-c1c6-4bd4-9eb5-b91366a80159 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.175886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.176607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.177090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.177380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.267299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:44.269313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:44.271740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd9bf-84ae-42ac-8c04-0a52d2253b5f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.319030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.321505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.322065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.322539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.326995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:44.329031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d5bc5-daff-47e4-a2ad-d09bfb8085d5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:44.336199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 217/427] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:44.339860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.340480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.341050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.369326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:44.370946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:44.405548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 211/428] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:44.406796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:44.524052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 218/429] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:44.525183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:44.621828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e1b0d-f286-425e-92c0-a3f405dedcbb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.665233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.666313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.666893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.667299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.668594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=0f2a482b7637419cbec280be7b6207b9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:44.669237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:44.671431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:44.680960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 212/430] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 611 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:44.682382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:44.810710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b314-8efe-4b80-a678-ba3eb3756643 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.871399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7798997-78ff-43c6-8a4b-4b35bcc7bb34 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:44.875408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.875408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.875408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.875408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.899566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:44.915683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:44.916617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:44.917883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 213/431] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:44.927174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:44.955199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:44.956124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:44.956528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:44.959414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] PATH_INFO: `/v3/projects/0f2a482b7637419cbec280be7b6207b9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:44.961216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] RBAC: Authorizing `identity:get_project(project_id=0f2a482b7637419cbec280be7b6207b9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:44.964275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:44.969218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 219/432] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/projects/0f2a482b7637419cbec280be7b6207b9 => generated 298 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:44.977584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:45.120660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105853c-cf2a-4739-a9f7-1ac1db8f0753 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:45.163761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6890792-5817-4123-a524-ba597824a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:45.164782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6890792-5817-4123-a524-ba597824a242 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.165209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6890792-5817-4123-a524-ba597824a242 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.166289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6890792-5817-4123-a524-ba597824a242 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.167215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6890792-5817-4123-a524-ba597824a242 None admin] RBAC: Adding query filter params (name=member) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:45.167690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6890792-5817-4123-a524-ba597824a242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:45.169228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6890792-5817-4123-a524-ba597824a242 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:45.196362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 214/433] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:45.208758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6890792-5817-4123-a524-ba597824a242 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:45.234258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536685f2-7a4d-44c7-af62-0256ce063f34 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:45.313031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:45.314565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.315339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.318171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.320630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:45.323529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:45.327607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 220/434] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:44 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:45.340651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:45.398109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6890792-5817-4123-a524-ba597824a242 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:45.473457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:45.474841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.476046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.476996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.553922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b042d-4e20-4d2b-b05e-ed8c45809612 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:45.603120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:45.604702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.605514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.606086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.608051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=0f2a482b7637419cbec280be7b6207b9) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:45.609019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:45.610713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461623-724a-4e0c-acef-3fa4aab864ce None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:45.618976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:45.621326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 221/435] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:45 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=0f2a482b7637419cbec280be7b6207b9&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 611 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:45.623168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e61a-cd45-40bd-8480-660e31bbea13 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.623706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e61a-cd45-40bd-8480-660e31bbea13 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.624249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90e61a-cd45-40bd-8480-660e31bbea13 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.628532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:45.630777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 222/436] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:45.633494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:45.633987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:45.634404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:45.663025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:45.664653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:45.767538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 223/437] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:45.805676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:45.835163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 215/438] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 17:30:45.843592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:45.959284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d4fa8-f3cf-470b-89dd-354727552e85 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:45.974131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cde1d-5a08-4849-82ad-6e35940d283d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.031750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.034288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.036417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.036813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.037164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.038094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.038609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.042288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.042482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:46.042482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:46.049625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 216/439] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:45 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:46.051247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.069263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:46.085760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:46.087825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:46.091443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 224/440] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:46.101928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.203634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd192fb1-1eb8-47b6-82ed-beab20c67aa4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.274099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.278717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.278717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.278717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.278717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:46.278717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:46.286135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 217/441] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:46.290939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.317759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644af6c-bb09-4257-bca6-889ec418b2e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.368996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.368996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.368996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.368996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.370173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:46.370765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:46.375419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce77da-b780-4955-90bc-a0a108685e8d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:46.386202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 225/442] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:46.388173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d7a9-fcf1-4a50-a648-fd034176d26e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.388782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d7a9-fcf1-4a50-a648-fd034176d26e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.389265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d7a9-fcf1-4a50-a648-fd034176d26e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.391001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 226/443] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:46.397682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9d7a9-fcf1-4a50-a648-fd034176d26e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.480614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed310f-5cbe-436f-9249-6d35530a4cda None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.533096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.534174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.535176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.539316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.539920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=c8cdd31ae58f4093a5a43e750e395e36, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:46.540448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:46.543022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf250-50af-47bf-90ea-e2b357637f39 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:46.552371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9d7a9-fcf1-4a50-a648-fd034176d26e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.559519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 218/444] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=c8cdd31ae58f4093a5a43e750e395e36 => generated 611 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:46.559519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.559519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.559519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.597635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:46.600331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:46.634475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.636051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.636763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.637245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.707468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 219/445] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:46.740711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.765759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:46.767301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:46.914044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc6b0a-bb36-4cde-90f9-2b9fd8b8ba50 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:46.945020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 227/446] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:46.952795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:46.975618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:46.976211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:46.976497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:46.976773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:46.992876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:47.001607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:47.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:30:47.003692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:47.004309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 220/447] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:47.011104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:47.100281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9a05c-ea53-44ad-944d-f621b7c5354e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.150589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.151510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.151794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.152321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] PATH_INFO: `/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.153559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=5b071a7a3b0741a084d4c1a568c6dd41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.155060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.155493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee0cf9-f4f5-4a89-9e7a-672474c60553 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.156853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 228/448] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:46 2022] GET /identity/v3/projects/5b071a7a3b0741a084d4c1a568c6dd41 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:47.163778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:47.202378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.203810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.205120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.207016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.207759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:47.208346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.210676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.227401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 221/449] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:47.234014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:47.281070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e491-49d1-4937-ae08-15714d919ef1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.323240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.325013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.325613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.326013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] PATH_INFO: `/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.328200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd915b36c9d4b25be6d6bfe837a0e64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.330994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.335426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 229/450] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/groups/dfd915b36c9d4b25be6d6bfe837a0e64 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:47.342539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:47.398745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b4019-7f30-4adc-b6a2-b3755600bb1f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.447304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.448140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.448653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.449640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.468493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6666b5-101e-4b97-bc3c-b95965e43557 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.517114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.518205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.518519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.519224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.520413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] RBAC: Adding query filter params (group.id=dfd915b36c9d4b25be6d6bfe837a0e64, role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:47.520814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.522283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.529320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 230/451] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/role_assignments?group.id=dfd915b36c9d4b25be6d6bfe837a0e64&scope.project.id=5b071a7a3b0741a084d4c1a568c6dd41&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:47.551431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.554279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.702355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 222/452] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 17:30:47.708594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:47.857946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372929c-dc1a-4020-8f4f-c281b109a5e1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:47.912007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:47.913158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:47.913421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:47.913697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] PATH_INFO: `/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:47.915081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] RBAC: Authorizing `identity:get_project(project_id=05b43e5ee8d94e7eabaa576aaa97efc1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:47.916809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:47.918654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 231/453] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/projects/05b43e5ee8d94e7eabaa576aaa97efc1 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:47.925713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:48.080872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2ad9-92d2-474a-9256-fab7deab55ae None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:48.118798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:48.119925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:48.120339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:48.120730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] PATH_INFO: `/v3/groups/b6a66ba42ed0489686d4796785020ecd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:48.122207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] RBAC: Authorizing `identity:get_group(group_id=b6a66ba42ed0489686d4796785020ecd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:48.123824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb23e-86e1-4738-971e-7f6d6d39cf95 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:48.125651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 223/454] 10.222.0.60 () {56 vars in 1180 bytes} [Tue May 10 17:30:47 2022] GET /identity/v3/groups/b6a66ba42ed0489686d4796785020ecd => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:48.132398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:48.247279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b09b-dbca-43f2-9bee-aaf9f697af2c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:48.282479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:48.283144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:48.283471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:48.283761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:48.284644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] RBAC: Adding query filter params (group.id=b6a66ba42ed0489686d4796785020ecd, role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=05b43e5ee8d94e7eabaa576aaa97efc1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:48.284960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:48.286423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280501b-2ce0-49e2-a74e-01f6b3239f40 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:48.292884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 232/455] 10.222.0.60 () {56 vars in 1376 bytes} [Tue May 10 17:30:48 2022] GET /identity/v3/role_assignments?group.id=b6a66ba42ed0489686d4796785020ecd&scope.project.id=05b43e5ee8d94e7eabaa576aaa97efc1&role.id=0d49494e76f84242bc3076803ab15e82 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:51.385440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0532ab7-3939-4b23-8a0d-e603b948f1e1 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:51.385440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0532ab7-3939-4b23-8a0d-e603b948f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:51.385440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0532ab7-3939-4b23-8a0d-e603b948f1e1 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:51.385440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 224/456] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:51.392612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ee25-5ac7-42c2-bb58-9712fb511164 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:51.393569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ee25-5ac7-42c2-bb58-9712fb511164 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:51.394631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ee25-5ac7-42c2-bb58-9712fb511164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:51.424856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0b84ee25-5ac7-42c2-bb58-9712fb511164 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:51.426528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0b84ee25-5ac7-42c2-bb58-9712fb511164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:51.565894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 233/457] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:51.594011 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0532ab7-3939-4b23-8a0d-e603b948f1e1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:51.710020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c56d-02c9-4582-b417-8ffa6fbfa4ed None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:51.710354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c56d-02c9-4582-b417-8ffa6fbfa4ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:51.715810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c56d-02c9-4582-b417-8ffa6fbfa4ed None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:51.723741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 234/458] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:51 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:51.724274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0532ab7-3939-4b23-8a0d-e603b948f1e1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:51.728176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:51.728776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:51.729383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:51.761472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:51.763200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:51.802189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:51.803073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:51.803542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:51.804022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:51.850911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 235/459] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:51.856093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:51.856093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:51.888602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:51.895257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:51.896326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:51.897171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:51.897171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:51.897171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:51.897171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:51.899181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 225/460] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:51.905031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:52.056291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a3755-6678-45e7-9d9a-5d4a7159e453 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:52.133223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:52.134429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.134907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.135400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.152950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:52.157707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:52.183556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3996-faf5-4296-89e5-d80787ba2ccf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:52.219063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:52.220346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:52.221718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:52.221718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:52.221718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:52.221718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:52.224924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 236/461] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:52.233130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:52.295436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:52.296700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.297371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.298036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.299645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:52.301290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:52.303053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:52.333550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 226/462] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:52.339134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:52.442789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f17f52-9774-4aa5-b20d-615e1d9274dc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:52.509156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:52.510458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.511067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.511551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.512665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:52.513442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:52.516642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:52.548724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 237/463] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:52.555564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:52.605674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e0f0a-e034-443f-813a-5646c004f75a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:52.650264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:52.650264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.650686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.650861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.651620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:52.653170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f4803-30ab-44a6-95b2-ac5ad23683f2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:52.701713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 227/464] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:52 2022] POST /identity/v3/users => generated 246 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:30:52.755901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ac188-6e01-4245-9f82-f9fef0790ec5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:52.798606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:52.799796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.800369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.800844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.802006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:52.804052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847cdada-ab04-44d0-9c14-38e650ccc432 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:52.830202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 238/465] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:52 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:52.846331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf443a7-f9a8-43e5-9abc-db71fcdb7d78 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.847510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf443a7-f9a8-43e5-9abc-db71fcdb7d78 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.848026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf443a7-f9a8-43e5-9abc-db71fcdb7d78 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.851353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 228/466] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:52.857695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfede-da20-48bd-aee7-fb95befb8639 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:52.858004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfede-da20-48bd-aee7-fb95befb8639 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:52.858181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dfede-da20-48bd-aee7-fb95befb8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:52.880938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-477dfede-da20-48bd-aee7-fb95befb8639 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:52.882217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-477dfede-da20-48bd-aee7-fb95befb8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:52.965835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 239/467] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:53.008389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf443a7-f9a8-43e5-9abc-db71fcdb7d78 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.037002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827312-953e-432c-a2da-ac3985bb051c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.037488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827312-953e-432c-a2da-ac3985bb051c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.037961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827312-953e-432c-a2da-ac3985bb051c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.042350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 240/468] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:53.047821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.048242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.048543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.079061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:53.080469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:53.168022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 241/469] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:53.182687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf443a7-f9a8-43e5-9abc-db71fcdb7d78 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.231600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.232409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.232697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.232959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.241086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.264858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.268286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:53.320777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:53.322380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:53.324147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:53.324147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:53.324147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:53.324147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:53.328038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 229/470] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:53.338058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.369598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22241256-5586-47d7-b26a-c6c224a1caa7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.406575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.407359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.407636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.407857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.419824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.421221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:53.442306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:53.444702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:53.446399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:53.446399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:53.446399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:53.446399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:53.447584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 242/471] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:53.450071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.560619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2583a-1a74-4c14-8196-8d96a831b5ae None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.561241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c77b9-f36c-4f3f-92a0-e33460996091 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.600151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.600840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.601125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.601406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.602161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:53.602473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.603945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:53.621930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 243/472] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:53.623336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.634070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.636207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.636990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.637759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.639441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:53.640302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.643297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:53.668068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 230/473] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:30:53.678292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:53.737205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b34f-753c-4847-ac35-0fa6abaf7bba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.775113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.775844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.776136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.776424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.777205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.778740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529e2eb-f778-4aa6-a860-eaba1b811120 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:53.822730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 244/474] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:53 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:30:53.909147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3668c-9023-443a-aad0-cda53c796472 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:53.986351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:53.988326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:53.989701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:53.990528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:53.992673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:53.996143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b9ee-1865-423d-8370-de8cd6ae7cdf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:54.036350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 231/475] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:30:53 2022] POST /identity/v3/users => generated 249 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:30:54.177453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8e3c-c166-465e-a7c4-50faee1e5a89 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:54.177751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8e3c-c166-465e-a7c4-50faee1e5a89 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:54.178072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8e3c-c166-465e-a7c4-50faee1e5a89 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:54.180094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 245/476] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:54.193047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:54.194003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:54.194938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:54.231590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:54.234375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:54.394354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 232/477] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:54.422105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8e3c-c166-465e-a7c4-50faee1e5a89 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:54.548400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8e3c-c166-465e-a7c4-50faee1e5a89 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:54.592206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1193-b907-4452-9984-555345796b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:54.593293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1193-b907-4452-9984-555345796b7a None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:54.593793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1193-b907-4452-9984-555345796b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:54.594347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1193-b907-4452-9984-555345796b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:54.595824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1193-b907-4452-9984-555345796b7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:54.597831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1193-b907-4452-9984-555345796b7a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:54.605896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.sql.core [None req-188c1193-b907-4452-9984-555345796b7a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 17:30:54.605896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 17:30:54.605896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [parameters: {'id': '478f9c46a05b42f2bda34531a67fa1b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 17:30:54.605896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80254) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-188c1193-b907-4452-9984-555345796b7a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 10 17:30:54.626642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return ref.to_dict() May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:30:54.627764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application yield resource May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.rollback() May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.force_reraise() May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise self.value May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application session.commit() May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 17:30:54.628986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._prepare_impl() May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.flush() May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._flush(objects) May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application compat.raise_( May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application flush_context.execute() May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rec.execute(self) May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 17:30:54.630129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:30:54.631729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:30:54.632717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [parameters: {'id': '478f9c46a05b42f2bda34531a67fa1b0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:54.633492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 17:30:54.634319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:54.637414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 246/478] 10.222.0.60 () {60 vars in 1131 bytes} [Tue May 10 17:30:54 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:54.643784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:54.845988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b42b3-f96f-435c-a175-8956bd2dd59e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:54.915879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:54.916986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:54.917363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:54.917795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:54.939248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c7b9828a-016f-432d-ad3a-d8ab54c20081 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:54.952882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:54.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:54.958079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 233/479] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:30:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:54.968215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1193-b907-4452-9984-555345796b7a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:55.199077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1193-b907-4452-9984-555345796b7a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:55.239873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:55.240998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:55.241527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:55.242034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:55.243039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:55.243660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:55.245513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc38979-9e7e-419f-8791-c8d98bab48dd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:55.256152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 247/480] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:30:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:56.495207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6969-50e7-431d-b71e-3ef7b1596748 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:56.495786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6969-50e7-431d-b71e-3ef7b1596748 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:56.496104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6969-50e7-431d-b71e-3ef7b1596748 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:56.497715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 234/481] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:56.504016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531902d-2ecd-4f51-a9c5-76af4ccbd68f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:56.504553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531902d-2ecd-4f51-a9c5-76af4ccbd68f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:56.504640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531902d-2ecd-4f51-a9c5-76af4ccbd68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:56.523297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1531902d-2ecd-4f51-a9c5-76af4ccbd68f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:56.524577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1531902d-2ecd-4f51-a9c5-76af4ccbd68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:56.617743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 248/482] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:30:56.643763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6969-50e7-431d-b71e-3ef7b1596748 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:56.742142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be220b-8205-47eb-b9d1-a8f5619e78d0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:56.742517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be220b-8205-47eb-b9d1-a8f5619e78d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:56.742899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be220b-8205-47eb-b9d1-a8f5619e78d0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:56.744576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 249/483] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:56.756000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:56.756333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:56.756574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:56.784504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:56.785829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:56.836356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6969-50e7-431d-b71e-3ef7b1596748 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:56.910463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:56.911293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:56.911610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:56.911892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:56.927644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 250/484] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 10 17:30:56.933317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:56.942197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:56.943171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:56.944008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 235/485] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:56.950488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:56.967496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.160457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ee7fe-2ebd-4e7f-a0f0-0a3a7cc6685f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.184519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a0c7a-68fe-4264-ab9f-1fdf59731cf5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.237854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.238741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.239035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.239325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.240150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:57.240560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:57.242102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:57.252827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 251/486] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:57.259621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.272708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.274162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.274640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.275115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.324778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:57.339854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:57.340899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:57.341789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:57.345825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 236/487] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:57.354719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.400771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832fed0-3b9f-4af7-a55b-875af5471bc3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.454042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.459654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.460301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.460830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.481649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:57.483169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0dbfc9d0-5e48-4411-9dba-5c27b7368796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:57.510949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:57.512391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:57.513288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:57.513288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:57.513288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:57.513288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:57.513288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 252/488] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:30:57.514165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fe86-d960-4db9-b46f-440215488807 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.514464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fe86-d960-4db9-b46f-440215488807 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.514751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fe86-d960-4db9-b46f-440215488807 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.516537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 253/489] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:57.522629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.522958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.523178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.541433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:57.542724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:57.545541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d6270-987f-4414-92f9-6e4bbafb1ca3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.585545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.586312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.586593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.586875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.587749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:57.588136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:57.589673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:57.600063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 237/490] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:57.601081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.624474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 254/491] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:57.625375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.717141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74560-df93-422f-bf62-4d419d9d84fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.763322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.764114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.764395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.764972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.765793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:57.766642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:57.768599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:57.776960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2941c-aa10-4691-8857-0c975a4caa87 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.785980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 238/492] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:57.786924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.856111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.857403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.857871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.858331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.879562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:57.882350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:57.915025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8a718-53ae-4e27-9eee-0a0073855c45 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:57.917443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:57.918384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:57.919208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:57.919208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:57.919208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:57.919208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:57.919869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 255/493] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:57.921446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:57.967577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:57.968770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:57.969075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:57.969526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:57.984471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:57.993903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:57.994908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:57.995769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:57.997390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 239/494] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:57.998830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.072943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3de4-afa1-4a97-badf-736cf9ec55b0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.131208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.132093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.132389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.132683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.140947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.142435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.149441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607805b0-ce2a-45d5-8e8f-bf490071d464 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ff912855-aae9-45aa-8d7a-3e64ebb1aa4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:30:58.160890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:58.162212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:58.163144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 256/495] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:58.164203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79f9c-e987-47eb-8908-0a604e5ddbec None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.164203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79f9c-e987-47eb-8908-0a604e5ddbec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.164203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e79f9c-e987-47eb-8908-0a604e5ddbec None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.167480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 257/496] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:58.167480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79f9c-e987-47eb-8908-0a604e5ddbec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.202645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.203518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.203818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.204105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.204910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:58.205475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.207997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.226820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 240/497] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:58.229107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.318282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e79f9c-e987-47eb-8908-0a604e5ddbec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.360156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.360943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.361232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.361577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.362442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:58.362780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.364247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e859-8f55-4171-a0c7-7664afa0ee05 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.380406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 258/498] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:58.380406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.380406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.380406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.391749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76561117-9d08-4e84-8682-8b495e65ebe2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.404210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:58.406273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:58.439612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.440998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.441514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.441944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.443424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:58.443976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.446726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.484482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 259/499] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:58.485270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.516399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 241/500] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:58.517547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.620910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1eb43-a06f-43df-8c01-635d63317998 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.649786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81996b5-187d-4970-b5db-a7e6be241dc7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.662013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.662906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.663194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.663506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.671980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.673593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.690928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.691931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3fae60f0-557b-403c-8a5f-bb7842491ea5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:30:58.692070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:58.693339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 17:30:58.695308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:58.696530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.696530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.696771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 260/501] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:58.696771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931b27-95b8-44d0-bc22-6b032742e3d1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.696771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931b27-95b8-44d0-bc22-6b032742e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.696771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30931b27-95b8-44d0-bc22-6b032742e3d1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.697407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 261/502] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:30:58.697832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30931b27-95b8-44d0-bc22-6b032742e3d1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.710780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:58.712426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:58.732081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:58.733606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 242/503] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:58.735296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:58.823338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30931b27-95b8-44d0-bc22-6b032742e3d1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.851594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d5671-d64f-4f7c-a648-9332e88117c6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:58.862794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.864017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.864455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.864755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.881113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:30:58.891083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:58.891901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:58.892211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:58.892496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:30:58.894869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:58.896071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:30:58.896883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:58.897495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 262/504] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:58.898702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.000115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.002508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.030234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384b27-2f5e-490d-9723-b235b51fad92 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.084269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.085337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.085798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.086249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.087767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:59.088277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.090821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5796093-bfd6-4f08-bd65-699ae95b9e95 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.158866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 263/505] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:59.158866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.158866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.158866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.165071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 243/506] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:59.166388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.182036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:30:59.183274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:30:59.258450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 264/507] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:30:59.259202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.291991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce6b11-ad54-4cb3-86b3-51094a7d3c11 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.349911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.350677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.351143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.351625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.352853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:59.353360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.355791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.375130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 244/508] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:59.376471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.405291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5fc78-88a1-4c82-8a2d-a7a28db72c46 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.444179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffc900-b988-4511-a109-645030658250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.444987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffc900-b988-4511-a109-645030658250 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.445272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffc900-b988-4511-a109-645030658250 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.445545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffc900-b988-4511-a109-645030658250 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.446451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffc900-b988-4511-a109-645030658250 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:30:59.446763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffc900-b988-4511-a109-645030658250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.448393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffc900-b988-4511-a109-645030658250 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.458083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 265/509] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:30:59.458946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffc900-b988-4511-a109-645030658250 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.545770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f50cc-c18e-41f0-bfb4-4afd7b0a4c43 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.576587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffc900-b988-4511-a109-645030658250 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.601014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.601966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.602356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.602764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.618664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.619763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.620172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.620455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.632374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.633994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:59.653793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:59.654748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:59.655617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:59.655617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:59.655617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:59.655617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:59.655617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 266/510] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:59.655897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.708860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.710490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.808595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87f2f-d9c5-440d-a8ed-83b828a1bb1f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.814655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 245/511] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:30:59.815849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.854550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.855392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.855681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.855959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:30:59.868000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:30:59.869787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:30:59.888351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:30:59.889541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:30:59.891003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:30:59.891003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:30:59.891003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:30:59.891003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:30:59.891003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 267/512] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:30:59.892324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:30:59.940837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610f50-2f36-4ec5-a00c-92c031ef6920 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:30:59.996987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:30:59.998318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:30:59.998819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:30:59.999305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.011033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.012708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.017113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c51e7f-56c4-4295-946b-4df571ac9dc5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:00.039834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:00.040828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:00.041902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 246/513] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:00.042900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.063331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.064322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.065060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.065982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.083136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.084704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:00.104013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:00.105885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 268/514] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:00.107585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.210745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819733d-0209-4aa2-a67d-d593ff541e77 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.224039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf5079-51d4-4b21-a49b-0ec866310b72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.262481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.263522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.263809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.264085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.271523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.272722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.273033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.273314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.274471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:00.275281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.277161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.278237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.278617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.292709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 247/515] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:00.293641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:00.297636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:00.298995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 269/516] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:00.300771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.426156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5099f-e95b-44f1-be6f-273abb112573 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.432328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc942df-3c55-40e1-bc60-20ddfbd1042c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.461786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.462485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.462766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.463050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.463832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:00.464150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.465548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.478368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 248/517] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:00.479443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.491177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768529-b612-442b-b391-9df53e6380ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.492189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768529-b612-442b-b391-9df53e6380ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.492672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768529-b612-442b-b391-9df53e6380ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.493158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99768529-b612-442b-b391-9df53e6380ef None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.494691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768529-b612-442b-b391-9df53e6380ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:00.495136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768529-b612-442b-b391-9df53e6380ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.497550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99768529-b612-442b-b391-9df53e6380ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.524075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 270/518] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:00.525423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768529-b612-442b-b391-9df53e6380ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.598627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e14e-640d-4243-a89a-85b8f5edfc8e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.636803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.637479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.637764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.638037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.638775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:00.639081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.640743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.653480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 249/519] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:00.654346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.688320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99768529-b612-442b-b391-9df53e6380ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.739753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.740562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.740847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.741124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.748249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.749725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:00.764794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:00.765777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:00.766625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 271/520] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:00.767116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.785632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bd4ed-37fa-4838-800a-1c626e7ebee9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.845785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.847638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.848148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.848607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.849638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:00.850121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.852826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.876783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 250/521] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:00.878699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:00.887197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f82cb-3bdc-495e-8858-43697bc45877 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:00.924137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:00.925642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:00.925642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:00.925976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:00.926571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:00.928314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:00.963491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 272/522] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:31:00 2022] POST /identity/v3/users => generated 247 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:00.963491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.042506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f446eba-c067-4a4b-ba66-9807037f664b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.088120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.088828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.089121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.089406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.120617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895d0a0-59a4-4673-adc5-de1efe433195 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.171586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.174211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.174211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.174211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.182435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.184371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.189204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.193519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:01.220260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:01.221183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:01.222403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 273/523] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:01.225066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.310107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 251/524] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:01.311114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.392179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612100-b74e-4293-928b-2e6fc1e45ea4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.436605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9530e1e-8ce1-4339-9cbb-492318ff7c52 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.445193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.446125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.446504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.446849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.448217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:01.448775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.451528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.482277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 274/525] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:01.482454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.482563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.482664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.482664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.482664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.491796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.494934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:01.513416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:01.515144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 252/526] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:01.516374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.639856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1380bc-e589-4c0e-a162-198e38acf08f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.641096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761b48-bd91-45d6-9644-b025c81d3f56 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.678674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.679524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.679800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.680085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.692031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.693506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.697612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.699568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.700963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.701665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.704363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:01.705142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.706858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:01.711754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:01.712678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:01.713522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:01.713522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:01.713522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:01.713522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:01.713522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 253/527] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:01.714125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.733330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 275/528] 10.222.0.60 () {56 vars in 1139 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:01.734987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.834530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db801e0f-4d7b-486c-990c-93cf9be043f0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.877647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.879119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.879428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.879785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.880784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:01.881107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.882608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:01.891520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 254/529] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:01.891520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:01.908745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07f52-d860-4260-a184-5fda028e0a10 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:01.980181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:01.981434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:01.982092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:01.982673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:01.984446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:01.985012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:01.988890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.016758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6a5b-5f20-46db-85a8-30df7ea2ab3f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.019299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 276/530] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:02.020918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.058528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.059806 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.060283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.060737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.061699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:02.062199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.063882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.083408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 255/531] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:02.085106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.159246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde12e76-db52-4f75-8e83-afa137785481 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.200905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.201603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.201909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.202182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.207203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ceb6-dcfc-4dbf-b62b-9a42bb6bfdb4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.257156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.258194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.258490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.258773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.260113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3860575c0bf3407198670e0f31ec2176) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:02.260440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.261909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.269638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 256/532] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/role_assignments?user.id=3860575c0bf3407198670e0f31ec2176&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:02.270512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.349337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.351050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.405753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7659381-62ef-40aa-ba02-9d0e13187244 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.457393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.458569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.459003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.459441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.480743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.482239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:02.529408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:02.531171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:02.539449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 257/533] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:02.541326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.555411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 277/534] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:02.564293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.710169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3679a-2ac8-4efc-83ce-985474c66d46 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.753892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.753892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.753892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.754251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.766588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.769150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.776183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd818-5570-4d0e-9bbd-6a8d6c837252 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:02.791400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:02.792353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:02.793531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:02.793531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:02.793531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:02.793531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:02.793531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 278/535] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:02.800793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.855304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:02.856147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:02.856310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:02.856554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:02.857366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:02.857681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:02.859137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:02.895766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 258/536] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:02.903669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:02.976992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55c913-0dc3-4271-825a-b10b630df694 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:03.032498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:03.034642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:03.035641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:03.036418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:03.038161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:03.038987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:03.041991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:03.077671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 279/537] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:03.089113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:03.140919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cd97d-d346-4efa-81b5-ecdcfb63519a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:03.185553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:03.186254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:03.186546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:03.186827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:03.187735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=0d12511650594add87c8753c0667d374) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:03.188055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:03.189608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:03.197529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 259/538] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:02 2022] GET /identity/v3/role_assignments?user.id=0d12511650594add87c8753c0667d374&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:03.309610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca25f26-e38a-4cc4-81a4-d31f6bf5408e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:03.378822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:03.380037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:03.380562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:03.381034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:03.408298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:03.410791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:03.458716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:03.460479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:03.462175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:03.471613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 280/539] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:03.484850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:03.672287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b890c-3d48-4f7e-929e-87b85ff4cb39 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:03.752752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:03.754483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:03.755286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:03.756102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:03.758008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:03.758949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:03.762147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e8fc1-d23a-42aa-a146-54cf6c70aed7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:03.787618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 260/540] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:03.797535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:04.036443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccbf8-c7c0-4a83-b69f-39e44f6b3da8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:04.037490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccbf8-c7c0-4a83-b69f-39e44f6b3da8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:04.038042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ccbf8-c7c0-4a83-b69f-39e44f6b3da8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:04.039859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 261/541] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:04.048045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:04.051387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:04.051387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:04.106590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:04.108736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:04.159156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eecdbd-75f9-47ee-8d7e-641b2ffcfa83 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:04.240168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:04.241167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:04.241540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:04.241942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:04.243410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=66e05683dc88495686fea4cf92a63928) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:04.243865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:04.246071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:04.266725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 281/542] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:03 2022] GET /identity/v3/role_assignments?user.id=66e05683dc88495686fea4cf92a63928&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:04.287039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 262/543] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:31:04.323040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:04.529037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de4eb-9a5f-4136-8aac-b8276719d34c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:04.584452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:04.585202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:04.585491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:04.585780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:04.598433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:04.606413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:04.607487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:04.608381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:04.609037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 282/544] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:04.615544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:04.775886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15183-c2f7-436a-b1da-01f0c198a447 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:04.825252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:04.826000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:04.826438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:04.826777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:04.827773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:04.828099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:04.829724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:04.845063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 263/545] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:04.850875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.052776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309de4-6136-4b55-a703-e3a04cd71c07 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:05.109154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:05.109945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.110237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.110519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.128938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:05.130482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bbc2cc60-bf01-4a2e-917f-a3219b383477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:05.152646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:05.153564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:05.155108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:05.155108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:05.155108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:05.155108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:05.155108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 283/546] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:05.160818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.315896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd615e-8d14-48e0-aea0-2f749801d93c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:05.354512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b930-d808-4062-b17c-ad82b89872d3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.354816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b930-d808-4062-b17c-ad82b89872d3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.355082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b930-d808-4062-b17c-ad82b89872d3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.356727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 284/547] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:05.360892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:05.361524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.361816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.362405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.363442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:05.363771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:05.364187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.364777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.365285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.365525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:05.381627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 264/548] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:05.387401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.405749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:05.407260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:05.545617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a575d-58d8-4548-a6ae-2625c9875fc7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:05.582556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 285/549] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:05.584983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:05.585991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.586469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.586892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.596295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:05.598826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:05.612479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:05.618583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:05.620953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:05.623225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:05.627045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 265/550] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:05.639083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.865085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb5dd0-a5ae-456e-b06b-8ca64b8b6ce6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:05.890624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60d30d-4b7b-4a5e-84bd-db2aa99b20be None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:05.936937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:05.938708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.939496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.941237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.944046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:05.944764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.945151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.945548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.946846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:05.947195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:05.948977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:05.957438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d03de84d-f740-42d1-be7b-0ce2e850fde1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:05.967798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:05.968764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:05.969559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:05.973615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 286/551] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:05.975347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce7ec-f327-480e-91c4-5a13a5f1740d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:05.975851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce7ec-f327-480e-91c4-5a13a5f1740d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:05.976349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ce7ec-f327-480e-91c4-5a13a5f1740d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:05.978259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 287/553] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:05.979225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ce7ec-f327-480e-91c4-5a13a5f1740d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:05.981316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 266/553] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:05.982610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.113553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ce7ec-f327-480e-91c4-5a13a5f1740d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.144855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d039f-950c-4b6e-8eb2-dfcfeaafedeb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.168859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.169845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.170250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.170572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.171469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:06.171871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.173323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bc492-df27-461b-8a5b-92044dc75673 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.187038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.188416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.188919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.189393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.190559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 288/554] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:06.193160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.193730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.194295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.218248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:06.219972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:06.280730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.283623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.303702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 289/555] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:06.304536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.421769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 267/556] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:06.422965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.449520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3dce-0f5c-4189-ac0b-a23b97dbe49c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.489563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.496444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.496444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.496444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.508556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.510160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:06.532261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:06.533221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:06.534719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:06.534719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:06.534719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:06.534719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:06.539041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 290/557] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:06.540181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.545455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0f716-158c-4ed8-9d3f-08eaaa770a05 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.595431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.597340 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.597713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.598004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.610286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5d36d264-9d91-4974-9b71-72d84ea73723 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:06.619475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:06.620739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:06.621710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 268/558] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:06.623765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3df9e-d4e9-43bb-82c1-ff08ca44137d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.623765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3df9e-d4e9-43bb-82c1-ff08ca44137d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.623765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3df9e-d4e9-43bb-82c1-ff08ca44137d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.624985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 269/559] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:06.630768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3df9e-d4e9-43bb-82c1-ff08ca44137d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.672585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc538-830e-4174-ab0a-6e5d88d03990 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.718912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.719674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.719947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.720295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.732058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.733550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:06.752345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:06.755028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 291/560] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:06.757806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.802992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3df9e-d4e9-43bb-82c1-ff08ca44137d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.858070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.858776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.859060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.859342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.860183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:06.860499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.861999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28a365-46bf-412b-9ecc-96708cf5784b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.875985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 270/561] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:06.877396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743098-075c-4cef-8641-928558008c03 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.878235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743098-075c-4cef-8641-928558008c03 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.878512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743098-075c-4cef-8641-928558008c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.896611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-67743098-075c-4cef-8641-928558008c03 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:06.897976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-67743098-075c-4cef-8641-928558008c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:06.916147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ce5bb-5f1f-4a3b-886d-3be06f538874 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:06.958387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:06.959309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:06.959785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:06.960220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:06.961128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:06.961621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:06.963010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:06.976726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 292/562] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:06.976726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:06.995236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 271/563] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:06.996662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743098-075c-4cef-8641-928558008c03 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.101072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7032adc-6536-4a66-adc1-12e0679301f2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.137200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.137917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.138238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.138522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.139260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:07.139633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.141076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.142452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743098-075c-4cef-8641-928558008c03 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.155898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 293/564] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:07.156767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.184475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.185280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.185560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.185977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.195271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.196950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:07.212887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:07.214175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 272/565] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:31:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:07.215090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.278950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5661-2b01-4564-98a3-d4515f7bba57 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.318203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.319020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.319310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.319617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.329416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec927-5dd5-4715-a83d-24a1e82e1740 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.335678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.337452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-52aae40e-a1fc-4684-9991-bd6d4245c4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:07.357018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:07.359338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 294/566] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2306-c2bc-4661-a232-2c64bdcacdd7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2306-c2bc-4661-a232-2c64bdcacdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.361597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2306-c2bc-4661-a232-2c64bdcacdd7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.364229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 295/567] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:07.365285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b2306-c2bc-4661-a232-2c64bdcacdd7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.372489 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.373433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.373779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.374059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.386456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:07.395102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:07.396617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:07.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:07.399587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 273/568] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:07.400606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.518085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b2306-c2bc-4661-a232-2c64bdcacdd7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.527616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbdb7c-2486-44bd-82b6-7b79724a6ac3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.566470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.567168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.567627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.567970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.569508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:07.570039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.573761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.576397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.577825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.578341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.578868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.592809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.595060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.599941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 274/569] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:07.600812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f558cdf7-97e1-42b1-9512-9e7b4be7fac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:07.621098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:07.622248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:07.623410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 296/570] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:07.625584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.626077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.626472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.654057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:07.655636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:07.712372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b6f24-0db4-4b2f-8a32-cb78ce384173 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.752129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 297/571] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:07.753093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.762213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.763329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.764043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.764366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.766300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:07.766300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.767132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.779623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 275/572] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:07.780435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.870192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3f5b8-0b7b-4209-a0d0-79fca200a61a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.887611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61acb-ff6a-4533-a7af-353bd0469384 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:07.907950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.908653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.909854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.910108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.910878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:07.911193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.912621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.921161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 298/573] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:07.921894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:07.928007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:07.928944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:07.929322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:07.929769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:07.942120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:07.943625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:07.962492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:07.964302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 276/574] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:07.966253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.045254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8e59-f57d-46a3-ad38-c45b3cdfe338 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.077275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea8754-51c2-4db4-9707-f7bee578f7a8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.079735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.080448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.081249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.081517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.082399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.082719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.084236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.099210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 299/575] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.100150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.116393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.117211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.117500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.117778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.128920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:08.139076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:08.140373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:08.141305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 277/576] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:08.144501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.206690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754f25b-5b5b-4e4a-912c-d9a46094124f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.253481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.254362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.254650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.254931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.257543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51785399-20a7-49df-b5fc-570f7a5130f8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.264448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.265944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:08.281901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:08.283112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 300/577] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:08.284704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.303896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.304982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.305463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.305949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.321159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.322845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:08.341967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:08.343440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 278/578] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:08.344552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.392524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133245d-c462-4d19-9cf5-fb726c041230 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.441655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.442893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.443531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.444004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.445398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.445977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.448634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.468734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2f732-a858-497b-b8b5-8fe14eb31909 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.470366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 301/579] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.472451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.511382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.512066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.512432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.512713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.513826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=e58f759fbae14125a0eb26807c8b98f5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.514155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.515888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.523418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 279/580] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/role_assignments?user.id=e58f759fbae14125a0eb26807c8b98f5&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.524781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.628958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06f08-029c-4616-8816-64eba6f79db9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.680421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885c11a-da77-4dab-bac7-6fbd02ec7649 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.686749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.687518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.687741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.687992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.688886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.689096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.691248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.707673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 302/581] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.707673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.726977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.727839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.728162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.728443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.729397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.729711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.731486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.751581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 280/582] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.752351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.828906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80aa9c-4c2f-42c4-90f0-345bea1c4813 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.874944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237ec2-deca-4136-9a63-18541f29b73f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:08.886130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.886808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.887407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.887942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.888999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:08.889335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.891053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.916256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 303/583] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:08.916256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:08.921843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:08.923229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:08.923794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:08.924301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:08.936078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:08.938106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:08.954119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:08.955080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:08.957208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:08.961274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 281/584] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:08.962154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.031329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ecd0-a203-4639-af54-c9c182b9da96 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.070067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.070907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.071186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.071499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.081636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd11c-592b-44d5-b8f5-deade67b7523 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.084081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.085581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:09.104861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:09.106448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:09.109082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:09.109082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:09.109082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:09.109082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:09.111049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 304/585] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:09.111839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.137658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.138932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.139533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.140099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.154943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.156567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:09.175211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:09.183797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 282/586] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:09.186115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.258899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf741-15e8-4c20-8c89-6f6d84f0c1f5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.292386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083325d9-8b42-44d6-bdcf-0748a2fc5d7e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.305595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.306613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.307022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.307425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.316864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.318553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:09.335445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:09.344105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 305/587] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:09.346148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.348250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.348250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.348250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.348250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.348785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:09.349933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.351919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.376937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 283/588] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:09.376937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.466640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c17f8-d2b7-4c56-850d-82c75d0b3dc1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.504700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.505388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.505670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.505947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.506564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba483-42f5-4eea-908d-365779816e1a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.506667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:09.506980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.508431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.524629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 306/589] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:09.524629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.558757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.559491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.559790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.560062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.560808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:09.561119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.562596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.580945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 284/590] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:09.580945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.631394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd0ad-bf2b-4125-bea7-25246eae8312 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.670523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.671533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.671990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.672412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.673412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:09.673922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.676292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.703186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 307/591] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:09.703186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.704901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d519-aa77-4788-94c6-2d92d881e428 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.747826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.748854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.749199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.749545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.767874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=3a3e49e317144906907311bac205bef9, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.770535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.795408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 285/592] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:09 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:09.795408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.836561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2680a-a4f8-4e00-8672-719c11760ec2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.880338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.881265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.881554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.881829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.891347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.892990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:09.912331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:09.913346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:09.914280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:09.914920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 308/593] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:09.916571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:09.928817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec43f07-7871-4474-aa1e-a0a6fb932db0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:09.974665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:09.975645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:09.976024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:09.976315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:09.984877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:09.986412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:10.005455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:10.007674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 286/594] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:10.009125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.048156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eb32a-9e48-482a-bf44-4ffb01128e8a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.089875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.090822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.091110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.095497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.106681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.108602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:10.128318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:10.129537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:10.130548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:10.130548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:10.130548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:10.130548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:10.132287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 309/595] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:10.133493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.136540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de09ee-c911-422a-8fe3-e0ffbec90271 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.182154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.182844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.183192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.183680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.185312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:10.185882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.188482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.209212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 287/596] 10.222.0.60 () {56 vars in 1139 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:10.210061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.258837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2500f0-5645-4f8a-b8fc-5075c0aaecc5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.300198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.301338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.301770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.302263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.303273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:10.303751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.305551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.320180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 310/597] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:10.321423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.329177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035c1a4-603d-420a-97bd-19c85dd1d477 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.380417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.381125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.382096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.382096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.383092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:10.383569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.385850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.408138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 288/598] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:10.410248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.450536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db15d43-4b23-4dce-a620-a4dc9032cad3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.492881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.493805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.494322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.494606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.509399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.513061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:10.537903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:10.538915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:10.539823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:10.539823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:10.539823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:10.539823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:10.545493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 311/599] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:10.545493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.559443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23224a33-9eed-4d56-884f-cdb7286d35b8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.615644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.616970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.617459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.617933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3860575c0bf3407198670e0f31ec2176/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.634860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=3860575c0bf3407198670e0f31ec2176, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.636782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.659567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 289/600] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:10 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3860575c0bf3407198670e0f31ec2176/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:10.661500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.720859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964103-94ff-4b5d-bc10-2fc24c67bdcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.826788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.827672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.828096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.828477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.847081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.849441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.863247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0d05d-7fa9-4b50-8450-514fc2629932 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:10.881309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:10.882288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:10.883178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 312/601] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:10.889148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:10.904291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:10.905458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:10.905940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:10.906418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:10.907357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:10.907903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:10.910180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:10.927743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 290/602] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:10.929720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.015963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ee3a-e1a8-4016-b17b-761489fb4836 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.055896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e762ff-7a5d-459d-947b-37ca5355b5b3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.068867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.070112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.070407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.071178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.072738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:11.073088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.076250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f04979-91c8-4ea5-9950-70c3959c6c1e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.099554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.099747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 313/603] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:11.101281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302c4-b600-463f-99f0-309ac6f446c8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.101764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302c4-b600-463f-99f0-309ac6f446c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.102208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302c4-b600-463f-99f0-309ac6f446c8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.103631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 314/604] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:11.104577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.104954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.105251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.108883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc302c4-b600-463f-99f0-309ac6f446c8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.120168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.121683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f0be4900-2739-4a6c-9b58-4141020ef764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:11.139450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:11.140831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:11.141700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 291/605] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:11.144180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.146945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.146945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.166404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:11.167980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:11.249185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc302c4-b600-463f-99f0-309ac6f446c8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.250231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 292/606] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:11.251158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.286395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.287965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.288315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.288602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/0d12511650594add87c8753c0667d374/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.311006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=0d12511650594add87c8753c0667d374, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.312905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.335102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 315/607] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:11 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/0d12511650594add87c8753c0667d374/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:11.336101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.392675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12a17e-bf1b-480e-a069-9d34e4bee3dd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.466256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.466946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.467234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.467541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.468365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:11.468679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.470129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.497493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 293/608] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:11.504928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.512398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51c375-1ef7-41f3-b950-763cb4026a8b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.583054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.584012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.584346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.584631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.596826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:11.604989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:11.605972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:11.607172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 316/609] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:11.613235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.654919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0508-c9af-4f8f-b1ea-2d100737571b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.694902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.695840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.696126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.696402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/66e05683dc88495686fea4cf92a63928/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.720397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=66e05683dc88495686fea4cf92a63928, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.721040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da28a8-73f5-4438-a01d-fd4fce953ef8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.722402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.754977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 294/610] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:11 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/66e05683dc88495686fea4cf92a63928/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:31:11.759563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.760259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.760581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.760875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.761713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:11.762030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.763595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.774693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 317/611] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:11.780147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:11.903439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87221e0-eff1-4f6a-b69f-10aabc31fc2a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:11.941158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:11.941983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:11.942271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:11.942552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:11.959285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:11.960875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:11.984345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:11.986424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:11.988615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:11.988615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:11.988615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:11.988615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:11.988615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 295/612] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:11.991918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.141729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974161-3c88-4988-9cdd-fe880e2d539a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:12.177600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:12.178370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.178660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.178938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.179751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:12.180063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:12.181571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:12.199675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 318/613] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:12.205027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.326249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735277ba-ed4f-4859-a934-c72890d23962 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:12.364484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:12.365510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.365801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.366084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.373896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:12.375307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2d89d100-cba0-414e-862b-26a6d702f0d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:12.390908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:12.392134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:12.394912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 296/614] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:12.399038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.444828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddad3-f5a8-4498-adcc-cab8a23c7610 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.445177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddad3-f5a8-4498-adcc-cab8a23c7610 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.445393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eddad3-f5a8-4498-adcc-cab8a23c7610 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.447040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 297/615] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:12.452108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.452349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.452596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.484417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:12.485648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:12.531793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e8e9-f3ff-4e47-b571-0ea4a4211d22 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:12.574865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:12.575574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.575976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.576735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.577756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:12.578147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:12.579791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:12.605002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 319/616] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:12.610840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.649900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 298/617] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:31:12.710123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.762181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a83af7-59bd-4070-9a4a-fee3d91aee3d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:12.841045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:12.841873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.842164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.842446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.861444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:12.863562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:12.890735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92436c39-abdc-4750-9a11-9de1fe98fd34 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:12.906747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:12.907734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:12.909748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:12.909748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:12.909748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:12.909748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:12.909748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 320/618] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:12.930828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:12.964068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:12.965522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:12.966043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:12.966559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:12.984056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:12.992845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:12.994581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:12.996218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 299/619] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:13.000138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.125721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016ef0-0f08-4660-8de0-56f134e270ab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.137618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461c4c6-e4a4-421e-9cdc-9521cc5474d5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.165897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.167324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.167870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.168360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.169376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:13.169916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.171629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.186304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 321/620] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:13.199425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.223243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.224200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.224690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.225147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.226088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:13.226577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.228199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.238639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 300/621] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:13.244298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.369617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387758-8660-40fb-be10-a5519d0676d8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.414506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.415314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.417179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.417472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.446180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.447758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.464970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494accb8-555c-4187-9a49-da8b86c60372 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:13.485661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:13.486586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:13.488767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:13.488767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:13.488767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:13.488767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:13.492844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 301/622] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:13.499460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.540232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.541074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.541322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.541600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.549108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.551242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:13.588549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:13.589506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:13.590381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:13.599856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 322/623] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:13.608726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.631977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95578f1-b9ab-4108-94c1-13c75fa8251b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.675037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.676117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.676749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.677639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.678876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:13.679468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.681499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e39eb9-4d34-4df4-a024-81c8eecc67be None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.698028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 302/624] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:13.702854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d2ed-eab3-4682-a8e2-f0d8b9da9c75 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.702854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d2ed-eab3-4682-a8e2-f0d8b9da9c75 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.702854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d2ed-eab3-4682-a8e2-f0d8b9da9c75 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.702854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 303/625] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:13.705214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d2ed-eab3-4682-a8e2-f0d8b9da9c75 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.737891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a010-191a-49a2-b1eb-edf909d8b16b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.776058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.776783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.777076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.777540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.778653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:13.778973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.780522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef691415-e4dc-4d59-a1d6-fa72977c4166 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.807074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 323/626] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:13.807074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.807074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.807412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.838766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:13.840721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:13.848983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d2ed-eab3-4682-a8e2-f0d8b9da9c75 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:13.890090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:13.891398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:13.891838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:13.892351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:13.901962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:13.903541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:13.921039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:13.922030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:13.922965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:13.927550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 304/627] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:13.928425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:13.949039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 324/628] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:13.949902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.036027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c6172-1113-4195-b93a-9ff9d45975db None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.070427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.071321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.071638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.071924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/e58f759fbae14125a0eb26807c8b98f5/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.075692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eca0f-3f0c-4fa3-83a5-6e900b513dee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.087577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=e58f759fbae14125a0eb26807c8b98f5, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.089043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.111764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 305/629] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:13 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/e58f759fbae14125a0eb26807c8b98f5/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:14.111764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.133957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.134901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.135188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.135523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.136412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:14.136729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.138238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436312d6-7ef8-41e5-a1b0-4b09865501a6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.158721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 325/630] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:31:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:14.160860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf78-b4b5-4877-b42a-290be136a94f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.161150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf78-b4b5-4877-b42a-290be136a94f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.161427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bf78-b4b5-4877-b42a-290be136a94f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.163116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 326/631] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:14.165281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bf78-b4b5-4877-b42a-290be136a94f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.233940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659fe4e-625f-4701-8436-c7c8623fd822 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.274687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.275940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.276361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.276521 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.284779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bf78-b4b5-4877-b42a-290be136a94f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.289568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4d07bcf4-8390-4e4d-8a53-5cc6f84eaaf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:14.297568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:14.300174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 306/632] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:14.302156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.312124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.312124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.319648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:14.321853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:14.329735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.331294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.331517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.331667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.416227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.418009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.431023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 307/633] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:14.433439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.528132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 327/634] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:14.529035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.613710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7c018-c407-46a4-b75a-4f461c7c6a9d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.667638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.668245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e0bc1-bd56-4395-aada-630c080c5df9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.669383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.670301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.671777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.672584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:14.672897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.674880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.689099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 308/635] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:14.690937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.715292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.716487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.716988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.717413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.730523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:14.740388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:14.741609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:14.742656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:14.749926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 328/636] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:14.751200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.802700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd404d1-05c1-416e-bfa1-91709f869217 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.844351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.845186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.845469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.845736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.857839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.859299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.866295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9820-0b8e-4a6d-ae0f-2cf291c842d1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:14.877479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:14.879133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:14.880059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:14.880059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:14.880059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:14.880059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:14.880059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 309/637] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:14.880982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:14.902154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:14.902962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.903251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.903563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.914452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:14.915994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-393e2976-36f3-4c29-bebe-80161b342ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:14.934440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:14.935570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:14.936658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:14.936658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:14.936658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:14.936658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:14.936658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 329/638] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:14.936984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795763c5-ca9a-4f1f-bd13-62f047ead12d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:14.941974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795763c5-ca9a-4f1f-bd13-62f047ead12d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:14.941974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795763c5-ca9a-4f1f-bd13-62f047ead12d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:14.941974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 330/639] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:14.941974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795763c5-ca9a-4f1f-bd13-62f047ead12d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.005378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0213c-4811-4931-9812-d150db4207e3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.040053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.040741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.041031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.041315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.042088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.042402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.043813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.056609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 310/640] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.056609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.057736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795763c5-ca9a-4f1f-bd13-62f047ead12d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.092162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.092890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.093178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.093514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.094247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.094566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.096086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623cbb6-a4e3-4450-ad36-8c16f774ece9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.107838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 331/641] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.109108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.109401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.109679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.125838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:15.126953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:15.178997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9847011-9ed4-4114-88bc-40175e455788 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.196119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 332/642] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:15.196990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.217135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.217825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.218115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.218396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.219129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.219487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.220873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.233461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 311/643] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.234400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.310474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e21cc-b499-4d69-9f83-d467702b9e0a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.337651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb349-8c13-4dcd-8271-f67f84cfe209 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.351595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.352413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.352701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.352982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.364529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.366183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.372305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.373114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.373405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.373807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.380635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.382016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:15.386137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:15.387178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:15.388132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:15.388132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:15.388132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:15.388132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:15.388132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 333/644] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:15.388699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:15.410642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:15.411920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 312/645] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:15.417699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.501712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77345979-425b-4fdb-943b-205503cca5fb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.519416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f27a28-7427-4639-8f03-2dc96af48ef4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.536556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.537362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.537647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.537926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.552425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:15.555105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.556154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.556733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.557233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:15.563802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:15.565594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 334/646] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:15.566568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.572729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.574700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:15.592722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:15.594009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 313/647] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:15.594957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.671694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7a97d-50b4-4288-929b-e68f86f951e5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.695388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e2985-9db5-4ad0-84fe-93a0217cf87f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.703596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.704261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.704585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.704815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.706157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.706644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.708056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.723750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 335/648] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.723750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.734370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.735044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.735352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.735661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.736461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.736866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.738454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.755425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 314/649] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.755425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.825907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21bf09-8c55-4df5-b464-02c8cea58403 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.857385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c319a-4e30-4024-b310-cc3732c7785b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:15.861821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.862578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.862863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.863138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.863921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.864390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.865914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.879060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 336/650] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.879060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.897570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:15.898309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:15.898598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:15.898881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:15.899834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:15.900100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:15.901533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:15.924932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 315/651] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:15.925870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:15.978749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c76fba-440c-473d-a5ba-fdd7078b1a71 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.011532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.012326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.012611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.012889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.021684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.023138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.030463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786399f-f24e-4457-b13d-4dfc4e0a7846 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:16.037802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:16.038947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:16.040135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:16.043493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 337/652] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:16.044319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.070260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.071195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.071687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.072110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.073083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:16.073541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.075141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.081179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 316/653] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:15 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:16.082158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.148761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab4032-b34f-4af4-ac1d-cc356a7a5b3e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.186596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.187590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.187978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.189141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.202849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.204566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:16.225394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:16.226536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:16.227655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:16.227655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:16.227655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:16.227655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:16.230809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902898bf-b0ad-4a67-8b19-06fd8f4204d0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.234415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 338/654] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:16.234652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.276719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.278309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.278782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.279251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.357008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe953c7-fbbe-4687-82d2-861519ff793a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.377153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.379729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.400153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.400828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.401120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.401404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.402264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:16.402582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.405264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.427456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 339/655] 10.222.0.60 () {56 vars in 1137 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:16.427456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.507506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 317/656] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:16.508699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.550054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcb6d9-065f-4fb5-8cdd-2fd720bb408a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.591191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.592082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.592442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.592733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.593504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:16.593794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.595170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.606823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 340/657] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:16.607676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.626120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e634c97-8b89-489a-93d0-a48466665701 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.661183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.662089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.662544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.662972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.706910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6a80a-b12d-4710-afce-7ae7a2486ca5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.734568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.736133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.747770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.748593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.748888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.749163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.761314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.762720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-60835fb4-0590-4c56-ae74-8961cb227935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:16.781144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:16.782298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:16.784120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:16.784120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:16.784120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:16.784120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:16.784120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 341/658] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:16.784580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086cbed-3bb2-4494-9d38-27c6e0fe3e53 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.784869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086cbed-3bb2-4494-9d38-27c6e0fe3e53 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.785134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086cbed-3bb2-4494-9d38-27c6e0fe3e53 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.790726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 342/659] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:16.790726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086cbed-3bb2-4494-9d38-27c6e0fe3e53 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.856246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 318/660] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:16.857372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:16.899226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086cbed-3bb2-4494-9d38-27c6e0fe3e53 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.937007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.938061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.938487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.938928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.948229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:16.949910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:16.954767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8da4-f946-40d9-a379-57edc5c4633f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-80f755e7-ac8d-4c87-8a3e-ee8e62350b41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:16.965521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:16.966691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 17:31:16.967811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:16.969926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 343/661] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:16.972331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.972790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.973065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.990719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:16.991955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:16.996265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:16.997027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:16.997387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:16.997738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:16.998575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:16.998984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.000464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.012327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 319/662] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:17.013503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.075401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 344/663] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:17.075401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.115937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03411755-e386-473e-8bc7-53aee80f5343 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.151991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.152793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.153085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.153369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.164877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.166346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.167938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d61bea-e9e4-4e07-8929-3c0848a75716 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:17.183473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:17.184599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:17.185689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:17.185689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:17.185689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:17.185689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:17.189105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 320/664] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:17.190277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.208010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.208692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.208988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.209253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.210106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:17.210529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.213127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.232657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 345/665] 10.222.0.60 () {56 vars in 1139 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:17.234298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.293768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a9729-a43e-4d89-bfb0-f8bf6299901b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.328355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.329518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.329808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.330084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.335731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e93da-b758-4ffd-bf7c-a0aad25a30fc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.337360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.338831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:17.354159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:17.355146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:17.356066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 321/666] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:17.357249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.377516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.379112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.379685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.380032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.393787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:17.402411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:17.404313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:17.406024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:17.409171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 346/667] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:17.410073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.464010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9792ad-816e-4e11-82eb-b56b1d76cdc4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.502889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.503628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.503908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.504183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.504920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:17.505226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.506606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.512687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49fa3-1251-4135-8d33-91891728820d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.523305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 322/668] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:17.523305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.552630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.553194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.553508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.553770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.641031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ea62-92d9-4625-a66f-9dd3adc7e79b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.648378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.649852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.679161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.679869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.680151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.680424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.681214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:17.681523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.682960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.695790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 323/669] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:17.696633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.760314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 347/670] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:17.761488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.798138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9abfc4-fa17-4d4c-92ca-8068f18db331 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.840024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.840726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.841016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.841297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.842069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:17.842382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.844299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.858019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 324/671] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:17.858019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.874397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bdd1e-b133-4ae9-a991-170d973ef996 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:17.909763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:17.910574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:17.910858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:17.911134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:17.918653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:17.920158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:17.934119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:17.935070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:17.936317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 348/672] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:17.936798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:17.967692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c691e5-cd21-4db2-87a8-c0bd03ab821d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.006073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.006739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.007023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.007303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.008182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3860575c0bf3407198670e0f31ec2176) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:18.008502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.009931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.016027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 325/673] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/role_assignments?user.id=3860575c0bf3407198670e0f31ec2176&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:18.016852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.046156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb110261-4527-46c4-b00e-f1f5d04e1f37 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.085118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.086204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.086689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.087122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.099435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.101254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:18.120255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:18.121378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:18.122469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:18.122469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:18.122469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:18.122469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:18.124417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 349/674] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:18.125498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.145717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b4785-7d6c-4d21-a75b-81cef4642ca8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.182609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.183451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.183757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.184206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.197330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.198567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:18.218097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:18.219120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:18.220038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:18.220038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:18.220038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:18.220038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:18.223551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 326/675] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:18.224537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.257930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a771c-832f-4d19-a989-3acf23a5d69b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.307159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.307894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.308182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.308463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.309294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:18.309611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.311115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.330124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 350/676] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:18.335776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.358655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a24af-c590-4e50-86a3-584ec3075787 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.404001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.405046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.405531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.406040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.406988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:18.407528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.409819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.423182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 327/677] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:18.428558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.496158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f530af-6eb6-4dea-81a4-7ef0870a4d37 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.533124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.534048 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.534262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.534528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.535270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:18.535688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.537134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.544976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bfae7-880a-483d-a4e1-ca627fa87663 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.551419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 351/678] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:18.551419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.591724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.592434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.592682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.592966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.593891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=0d12511650594add87c8753c0667d374) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:18.594217 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.596319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08fc79-a8c9-47c0-92ea-27d920f08331 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.602660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 328/679] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/role_assignments?user.id=0d12511650594add87c8753c0667d374&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:18.604082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c2dd-654a-4d77-a423-66ee5fa0ae16 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.604378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c2dd-654a-4d77-a423-66ee5fa0ae16 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.604663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538c2dd-654a-4d77-a423-66ee5fa0ae16 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.610171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 329/680] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:18.610171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538c2dd-654a-4d77-a423-66ee5fa0ae16 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.696400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a6166-188e-4ca0-a300-aad5336fe88e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.741176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.742007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.742300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.742582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.744343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538c2dd-654a-4d77-a423-66ee5fa0ae16 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:18.750477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.752037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-634e1df3-d5c9-47c3-b149-e4383a092c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:18.770550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:18.771598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:18.772492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 352/681] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:18.773517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.773810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.774092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.791064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:18.792379 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:18.792512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:18.792925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:18.793423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:18.794007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:18.803018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:18.804769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:18.822543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:18.823751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:18.824719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:18.825266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 330/682] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:18.826094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.891900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 353/683] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:18.893151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:18.958808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7fc41-9158-4773-b225-d5cbfcdc2e16 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.004900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.005691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.005986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.006268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.007083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:19.007423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.008389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9f86-0669-48f9-ba9d-5177a4d5f9de None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.008872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.027157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 331/684] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:19.027157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.051005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.052078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.052562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.053032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.054170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:19.054686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.056515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.076543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 354/685] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:19.077753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.132869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811944-f63e-4018-9a7e-c94a9f66339e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.168100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.168915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.169204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.169486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.181258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:19.184119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04962e7f-a948-4cf5-a8b3-1389a6316564 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:19.188961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:19.190729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:19.191741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 332/686] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:19.192447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.224530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.225600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.226128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.226624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.227718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=66e05683dc88495686fea4cf92a63928) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:19.228316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.230026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.243484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 355/687] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/role_assignments?user.id=66e05683dc88495686fea4cf92a63928&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:19.244856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.362307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf21c3-ef86-40dc-8880-a17eb4f85bf3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.368815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5cda-b198-4547-b619-24cdc2207277 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.412303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.413382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.413939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.414412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.415500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:19.416082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.417776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.429183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 356/688] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:19.437645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.464209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.464890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.465181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.465472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.590933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.592768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.631655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c4ef5-bf24-457b-afee-f81911ea10ba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.670770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.671544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.671834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.672114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.684333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.685728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:19.704167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:19.705124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:19.706243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:19.706243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:19.706243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:19.706243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:19.706243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 357/689] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:19.711450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.716866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 333/690] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:19.723598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.815424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d744d4-17de-450c-be0a-70ec42d508ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.848939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.849621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.849907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.850186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.850927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:19.851256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.852665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:19.865354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 358/691] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:19.870705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:19.895700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b2aea-0957-4f9c-abc5-fefaa0b22127 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.969131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:19.969864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:19.970147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:19.970422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:19.973665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915aea-8118-4c53-960b-1165d39c1413 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:19.981164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:19.982617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:20.001397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:20.002509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:20.003456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:20.003456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:20.003456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:20.003456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:20.003456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 334/692] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:20.008458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.022994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.023861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.024142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.024417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.041216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.045086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:20.083902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:20.086100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:20.088358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 359/693] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:31:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:20.092360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.223834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fa2e-bb6c-40d7-a511-af16aec013ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.250231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be508459-79b5-4e01-be2e-31e460a87531 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.271392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.271392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.271392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.271392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.271835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:20.271835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.271835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.296034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 360/694] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:20.297493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.338296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.339042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.339331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.339634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.340376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:20.340688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.342060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.374154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 335/695] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:20.380097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.426582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e117eb-43f1-49be-9181-70f1e8f237de None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.464452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.465113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.465566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.465846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.542962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.544383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0fe20-812b-4926-b1c4-ebb76471bbb9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.601409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd48b9-dbe5-4404-8e2e-2de7ca91aa10 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.637425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.638653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.639151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.639661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.647640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.649437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.652028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 361/696] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 17:31:20.653387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c8e2d-9d46-4355-b2d3-cd18109cd333 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.653679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c8e2d-9d46-4355-b2d3-cd18109cd333 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.653959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c8e2d-9d46-4355-b2d3-cd18109cd333 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.663929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 362/697] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:20.663929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c8e2d-9d46-4355-b2d3-cd18109cd333 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-bf19c7f6-323d-4b5c-bb3f-f4dc437d21c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:20.669960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:20.670833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:20.671835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:20.674842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 336/698] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:20.676409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.676901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.677373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.695595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:20.697224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:20.765630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c8e2d-9d46-4355-b2d3-cd18109cd333 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.775459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 337/699] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:20.776737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.800934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.801652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.801940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.802217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.812882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.814463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:20.835240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:20.836223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:20.837131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:20.837131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:20.837131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:20.837131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:20.837131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 363/700] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:20.837828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.908916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dab42-f6d9-4106-83f5-48c6a640f0dc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.945952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.946838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b2b30-9ef0-4773-899d-a3b28198d313 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:20.947231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.947879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.948389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.949385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:20.949893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:20.964511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 338/701] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:20.965909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:20.983558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:20.984664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:20.984664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:20.984960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:20.995753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:20.997265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:21.015403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:21.016395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:21.017295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:21.017295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:21.017295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:21.017295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:21.017295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 364/702] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:21.022738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.077241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9c76-9607-4c36-96ac-c95c4716a398 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.113342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.114447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.114939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.115487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.116479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:21.117004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.118627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.121912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c5bf5-c255-43cd-b7e3-3210a9aef41e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.137890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 339/703] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:21.139245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.160549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.161266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.161561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.161842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.163133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=e58f759fbae14125a0eb26807c8b98f5) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:21.163133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.164650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.171262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 365/704] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/role_assignments?user.id=e58f759fbae14125a0eb26807c8b98f5&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:21.172247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.246030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d46b3-629e-4b47-b09e-6501d730f0a7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.281924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c56e-9e48-427b-9e5a-c77c07a14ddc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.284122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.285081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.285563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.286057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.286988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:21.287517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.289101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.302570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 340/705] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:21.308381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.319859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.320677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.320961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.321239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.331379 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.332874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.427505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a92329-b2be-4f36-afe1-d1846716a142 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1afbe817-7112-4d9f-8e59-1b7520265a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:21.476210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:21.477178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:21.478054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 366/706] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:21.483479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a72d-ae91-4b28-8ffe-cbbb557d3996 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.483789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a72d-ae91-4b28-8ffe-cbbb557d3996 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.484056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9a72d-ae91-4b28-8ffe-cbbb557d3996 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.485723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 367/707] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:21.487055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9a72d-ae91-4b28-8ffe-cbbb557d3996 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.488454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.489399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.489897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.490396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.491328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.497284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e87c-5c34-4590-9516-5910b7dcab1e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.522969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 341/708] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:31:21 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:31:21.524845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.525321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.525786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.544752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:21.546346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:21.630427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9a72d-ae91-4b28-8ffe-cbbb557d3996 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.658020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 342/709] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:21.681775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.682537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.682824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.683152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.684007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:21.684320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.685784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.694779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.701448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 368/710] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:21.707858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:21.804439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df207-7347-4db6-9816-53faf1938359 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.816921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3b38c-bdfb-4ca7-966e-7b89c8775019 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:21.856915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.857749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.858038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.858317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.859000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.860716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.870952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:21.871670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:21.871957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:21.872240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:21.873116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:21.873432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:21.874947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:21.880718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:21.881734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:21.882583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:21.883412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 343/711] 10.222.0.60 () {56 vars in 1129 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:21.883498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 369/712] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:21.890205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:22.016986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6413d5-94a3-4935-a4b6-e62b868683c9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:22.056113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:22.056854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.057142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.057418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.058152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:22.058461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:22.059909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8ebbf-f9b6-4107-97cc-facb91a4c364 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:22.066066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 344/713] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:22.071905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:22.110334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36176f-f7dc-41d5-bde4-bd11a225b5c4 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.110683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36176f-f7dc-41d5-bde4-bd11a225b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.110895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36176f-f7dc-41d5-bde4-bd11a225b5c4 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.113322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 345/714] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:22.126894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.127868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.128057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.157776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:22.159053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:22.206039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a13f90-764b-447c-8299-dbeb3cc9e297 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:22.247598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:22.248693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.249254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.249749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.250733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:22.251187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:22.251879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 346/715] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:22.259420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:22.266631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 370/716] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:22.276043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:22.383916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597216-559e-40cd-a6d1-98a8490f4b54 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:22.422727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:22.423601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.423889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.425213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] PATH_INFO: `/v3/services/network` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.425352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:22.426879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:22.440379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:22.442302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:22.445012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 347/717] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:22 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:22.459827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:22.590157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1c162-375b-400e-b8bf-85a1799590c0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:22.634313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:22.635008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.635295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.635609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.636341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] RBAC: Adding query filter params (name=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:22.636652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:22.638193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56dcca-e474-44f7-9956-a0ad11c0f733 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:22.644530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 371/718] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:22.650679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:22.779320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f4f32-8d26-43a9-8936-3aafd15ea39b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:22.822871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:22.823587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:22.823880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:22.824162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:22.824888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] RBAC: Adding query filter params (type=network) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:22.825214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:22.826578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653fc77-62e2-4eca-adf7-27040954faef None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:22.834140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 348/719] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:24.618321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf0b-9773-4777-bb8a-68c9533397e8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.619498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf0b-9773-4777-bb8a-68c9533397e8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.620012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf0b-9773-4777-bb8a-68c9533397e8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.621835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 372/720] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:24.627126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774744d-cee2-4d04-bf9f-e2604e2a925b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.628624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774744d-cee2-4d04-bf9f-e2604e2a925b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.629125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774744d-cee2-4d04-bf9f-e2604e2a925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.651579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8774744d-cee2-4d04-bf9f-e2604e2a925b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:24.653131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8774744d-cee2-4d04-bf9f-e2604e2a925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:24.686136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369036e5-0a52-4b8a-9c66-957b5a48d119 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.686448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369036e5-0a52-4b8a-9c66-957b5a48d119 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.686695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369036e5-0a52-4b8a-9c66-957b5a48d119 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.688370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 373/721] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:24.690606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0217ef-ae8d-4fca-91d9-0d973cbe4ab2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.691160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0217ef-ae8d-4fca-91d9-0d973cbe4ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.691703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0217ef-ae8d-4fca-91d9-0d973cbe4ab2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.693690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 374/722] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:24.695225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.695889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.696371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.716177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:24.717687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:24.751389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 349/723] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 17:31:24.751389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.751389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.751389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.765102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:24.766300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:24.815799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 375/724] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:24.817787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:24.860528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 350/725] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:24.861710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:24.931793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda58c0-c949-43c6-ba18-8766a324c66a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:24.966997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:24.967833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:24.968294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:24.968737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:24.980793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:24.989039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d20e4-97df-404e-b26e-d0223e2d4b7b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:24.989784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:24.990970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:24.992089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:24.998869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 376/726] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.000090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.025817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.026647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.027117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.027601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.040553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:25.048824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:25.050068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:25.051006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:25.053385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 351/727] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.058955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.113228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f36b4-add5-4430-a604-8442b3730cb9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.150640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.151521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.151819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.152098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.163572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:25.165060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7afde-1d6b-4acc-a501-8f3fc2375a3a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:25.171443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:25.172442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:25.173278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 377/728] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.174531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.209424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.210357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.210797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.211274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.212254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:25.212727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.214286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.223826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 352/729] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:25.224956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.282351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2530ba1-5ff5-4c12-ab1c-4df583f33980 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.317692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.318374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.318664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.318946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.319739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:25.320060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.321465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53112d0a-c061-4aea-88cc-9b9c29ff0337 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 378/730] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eba8a-7a81-4dd3-8dad-0b880adcc3a1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eba8a-7a81-4dd3-8dad-0b880adcc3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eba8a-7a81-4dd3-8dad-0b880adcc3a1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 379/731] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:25.337113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eba8a-7a81-4dd3-8dad-0b880adcc3a1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.342192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b299d-b9a6-4330-9caf-bdc12bb8bebd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.377077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.378663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.379171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.379670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.380665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:25.381035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.382578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.391902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 353/732] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:25.393346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.453194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eba8a-7a81-4dd3-8dad-0b880adcc3a1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.490463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.491178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.491507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.491790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.504961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99078-edcc-46f1-950f-30f9e87a0fd6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.507293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.508823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c105f733-b94b-4a60-95df-b4cb11d21ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:25.527912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:25.528997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:25.529970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:25.529970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:25.529970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.529970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:25.529970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 380/733] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.530764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.530937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.531196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.549231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.549735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.550023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.550364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.551348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:25.552637 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:25.562618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.564170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:25.585355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:25.586733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 354/734] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.587878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.635750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 381/735] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:25.636622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.709616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00694f19-9af0-493e-8cd1-e3f979e3e60b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.742792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.743535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.743824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.744110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.748272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a1a9d-bc49-4d71-bd4e-aaaaf6ff1658 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.755601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.757062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:25.774314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:25.775354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 355/736] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:25.776280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.787303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.788006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.788290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.788568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.789303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:25.789609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.790977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.801928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 382/737] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:25.802718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.874731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf881c2-08a0-4e77-8edf-a14e73c9ee1e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.901902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec3a3b-b310-48aa-bee4-c45f19b48d6f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:25.912205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.912872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.913158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.913434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.914170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:25.914478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.915876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc360-796c-4498-981d-e4820653bf63 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.928127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 356/738] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:25.929411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26320f9-5f9f-47ae-9bd0-cd4ec597984a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.929697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26320f9-5f9f-47ae-9bd0-cd4ec597984a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.929970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26320f9-5f9f-47ae-9bd0-cd4ec597984a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.931176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 357/739] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:25.931882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26320f9-5f9f-47ae-9bd0-cd4ec597984a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:25.940717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:25.941387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:25.941673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:25.941951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:25.942683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:25.944082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:25.958293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 383/740] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:25 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:25.959098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.054422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26320f9-5f9f-47ae-9bd0-cd4ec597984a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.071895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02293-fbc6-4919-9a37-cd25de946541 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.091003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.091798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.092092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.092427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.093185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:26.093503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.094945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.113662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 358/741] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:26.113662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.116158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.117012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.117300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.117582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.126155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.127964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-753bbb5e-17d3-4d5f-bbd8-19d4bdf21dda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:26.143552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:26.144693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 384/742] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:31:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.146725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.147771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.163608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:26.164851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:26.223478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d007-72fd-48ee-913e-15443d791b47 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.241532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 385/743] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 17:31:26.242791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.263194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.264196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.264330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.264635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.272114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.273575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:26.290411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:26.291522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 359/744] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:26.292472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.362193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9157c6d-a762-4376-a99a-7d786418d22e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.401094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.401922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.402206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.402479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.410842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.412437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:26.428528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:26.429565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 386/745] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:26.435979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.515499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0255-4ef9-48e4-bc8f-d662bfda259a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.547531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0655f-9f23-4f2e-a1b6-b4e60d2c83b9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.549385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.550070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.550355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.550638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.551526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:26.551837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.553271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.576702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 360/746] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:26.576702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.588788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.589458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.589746 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.590022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.590747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.592143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.605366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 387/747] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:26 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:26.606593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.704311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26fb89-db88-4104-87b1-b5762373a2ea None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.729120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ddb9c-6772-4f40-9501-b10e852906fc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.745603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.747030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.747585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.748091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.749267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:26.749817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.751621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.767083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.767862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.768280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.768280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.769497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:26.769818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.771498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.780124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 361/748] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:26.781443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.795200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 388/749] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:26.795200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:26.914399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41371-279f-4cf6-82fb-eb395ed595c1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.930744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17a080-0376-4121-b245-ae5872016246 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:26.950911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.951812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.952167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.952380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.962907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:26.964456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:26.976816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:26.977749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:26.978206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:26.978642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:26.983190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:26.984297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 362/750] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:26.985478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.056462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.058014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.128525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812e847-befa-429c-9464-948e0f2c43e1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.169635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.175311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.175311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.175311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.175687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 389/751] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:27.176606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.256404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.258230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.299672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962fe15-1a03-43d0-94b0-33585a5f29a9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.337168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.337860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.338150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.338435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.339184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:27.339534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.340964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.354339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 390/752] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:27.355299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.375664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 363/753] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:27.376976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.466333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8768d1-b7cf-48ed-b6c8-b9f6d37901c7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.491603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc9a4-1cb4-4879-924f-81171785158f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.502552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.503741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.503741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.504024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.515408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.516898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.531200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.532389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.532924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.534154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:27.535911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:27.536868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:27.537755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:27.537755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:27.537755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:27.537755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:27.541780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 391/754] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:27.542760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.546133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.547987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:27.564504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:27.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:27.566850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:27.569524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 364/755] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:27.570807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.651646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d7324-51a8-4eb0-b058-a92878846025 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.681127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d945dfd-0cae-477b-aa53-5c66e440a8ff None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.694501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.695692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.696221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.696701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.708828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.710680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.722537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.723210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.723536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.723822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.724572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:27.724894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.726268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:27.732457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:27.733709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:27.734654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:27.734654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:27.734654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:27.734654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:27.741145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 392/757] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:27.742383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.745355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 365/757] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:27.746022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.863183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618cb8e-1521-44aa-8580-3486959e18ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.865140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939071-7173-4302-8ee2-11950ac6f32d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:27.901590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.902517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.902953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.903816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.904863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:27.905387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.907473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.910083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:27.911199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:27.911588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:27.911949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:27.921085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:27.922966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:27.925032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 393/758] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:27.926301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:27.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:27.942881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:27.943872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:27.947570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 366/759] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:27.949932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.063063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb850ef-d12e-47f0-9dc2-65186f8dd646 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.082429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146549-df80-4170-8541-c422cdd7247f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.103560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.104489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.104924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.105390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.106319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:28.106893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.108735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.126096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 394/760] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:28.126096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.129736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.131612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.131907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.132198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.134346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=3a3e49e317144906907311bac205bef9, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.136045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.152944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 367/761] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:27 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:28.154341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.265150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac18b3-f6bb-4e2c-9af8-31df47f8ba96 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.279209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1f694-796b-48bd-ac5d-c1199a91e550 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.316052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.317170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.317465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.317749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.318838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:28.319162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.321012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.322635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.324011 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.324854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.325754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.336747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.338070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 395/762] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:28.339023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.344013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:28.358828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:28.360098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:28.361021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:28.367643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 368/763] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:28.370584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.501615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686bcc6-07e0-4c38-ba75-8c2317548934 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.548765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.550046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.550568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.551247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.553130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=855c179ded264256ab7868e39756b3d2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:28.553706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.556390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d9db3-19ba-409a-87ed-d65b8e32e210 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.558143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d395-263e-4a40-879b-30d1abdfe451 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.565545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 396/764] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/role_assignments?user.id=855c179ded264256ab7868e39756b3d2&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:28.567339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caaf71-5853-48a8-80f2-c1e13225b19e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.567867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caaf71-5853-48a8-80f2-c1e13225b19e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.568997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7caaf71-5853-48a8-80f2-c1e13225b19e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.571634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 397/765] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:28.577618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.578616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.579116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.603465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:28.605123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:28.607244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.608247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.608556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.608897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.609703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:28.611073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.613657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.635474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 369/766] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:28.637354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.697200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 398/767] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:28.723549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:28.755558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539397c-41c2-4da7-a1b9-997c5e8bee11 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.798580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.799503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.800093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.800369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.801304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=e58f759fbae14125a0eb26807c8b98f5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:28.801656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.803180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.812937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 370/768] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/role_assignments?user.id=e58f759fbae14125a0eb26807c8b98f5&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:28.889086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99869a-9cf8-41af-8f55-b0e4f14d723d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:28.934698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:28.935572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:28.935862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:28.936177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:28.936823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:28.938238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:28.954040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:28.955679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:28.956767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 399/769] 10.222.0.60 () {56 vars in 1129 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:28.966478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.096586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95ca2-3e6f-4b4d-94d4-dfb1f32df7e2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.135508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.136672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.137252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.137751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.138725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:29.139320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.141029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe0ca7-d131-4ecb-9606-eca53e313068 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.148008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 371/770] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:29.156521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.267274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136e780-ad5d-4629-8985-a5d2f21d78e4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.314302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150f02-590d-482f-834d-b15e069e609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.316323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150f02-590d-482f-834d-b15e069e609f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.316821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150f02-590d-482f-834d-b15e069e609f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.317302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15150f02-590d-482f-834d-b15e069e609f None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.322404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15150f02-590d-482f-834d-b15e069e609f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:29.322730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15150f02-590d-482f-834d-b15e069e609f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.323450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b817f3-1709-49e4-ac6d-625d168e3f1b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.323954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b817f3-1709-49e4-ac6d-625d168e3f1b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.324283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15150f02-590d-482f-834d-b15e069e609f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.324676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b817f3-1709-49e4-ac6d-625d168e3f1b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.326632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 372/771] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:29.331570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 400/772] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:29.332772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272543a-c797-402e-bb36-75a437f2399c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.333073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272543a-c797-402e-bb36-75a437f2399c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.333354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272543a-c797-402e-bb36-75a437f2399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.337212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150f02-590d-482f-834d-b15e069e609f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.369433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9272543a-c797-402e-bb36-75a437f2399c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:29.370648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9272543a-c797-402e-bb36-75a437f2399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:29.470411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 373/773] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:29.511496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272543a-c797-402e-bb36-75a437f2399c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.540208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15150f02-590d-482f-834d-b15e069e609f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.593059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.594111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.594607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.595122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.597125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] RBAC: Adding query filter params (interface=public, service_id=1ef6a221fe7142a79e00cd5743f4a10a, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:29.597721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.599313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.618700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 401/774] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/endpoints?service_id=1ef6a221fe7142a79e00cd5743f4a10a&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:29.624461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.648856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272543a-c797-402e-bb36-75a437f2399c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.684912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.685612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.685902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.686182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] PATH_INFO: `/v3/services/network` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.686907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.695396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:29.709880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:29.710945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:29.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 374/775] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:29.718164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:29.781893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116836a-dd01-49b5-bac5-8901173a20cd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.828735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.829506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.829799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.830880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.833390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.834831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.847486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 402/776] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:29.898420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6da0-66fa-4026-aaae-d40455ebd861 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:29.939125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:29.940879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:29.941208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:29.941490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:29.942234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] RBAC: Adding query filter params (name=network) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:29.942550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:29.943994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:29.949721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 375/777] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:29.956114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:30.115763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6fd95-4f83-4616-adf5-d7636d8fd42d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:30.151871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:30.152900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:30.153417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:30.153901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:30.154870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:30.155502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:30.157093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:30.163040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 403/778] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:30.168662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:30.281588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2a0e0-da29-4524-a0ac-c5366ce51060 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:30.320105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:30.321177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:30.321672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:30.322150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:30.323221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] RBAC: Adding query filter params (interface=public, service_id=ca9d949a7a6d4fc994a6e5df7cf608f9, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:30.323791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:30.325414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334d33b-6ecf-467d-bef0-decb472e40e3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:30.341352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 376/779] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:31:30 2022] GET /identity/v3/endpoints?service_id=ca9d949a7a6d4fc994a6e5df7cf608f9&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:30.347676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:30.457227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02615c-55c0-4f41-b42c-747d2550a9aa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:30.508068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:30.509123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:30.509616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:30.510122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:30.511028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:30.512747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9e311-e4b2-464e-97c6-f3c0a1defd5c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:30.519289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 404/780] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:30 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:31.188887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb927e6-b975-4b2d-be43-145cf8387094 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.189563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb927e6-b975-4b2d-be43-145cf8387094 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.189563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb927e6-b975-4b2d-be43-145cf8387094 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.191320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 377/781] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:31.205885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.207130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.207656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.236543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:31.238494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:31.333023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 405/782] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:31.368474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb927e6-b975-4b2d-be43-145cf8387094 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:31.494103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb927e6-b975-4b2d-be43-145cf8387094 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:31.530160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:31.530978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.531265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.531628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.544193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cd2a5656-dc0d-496c-8bba-9140586527e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:31.552679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:31.553726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:31.554580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 378/783] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:31.560503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:31.618249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9394-409c-4c04-82ab-3da9645e5262 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.618620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9394-409c-4c04-82ab-3da9645e5262 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.618979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c9394-409c-4c04-82ab-3da9645e5262 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.620892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 379/784] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:31.626377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9011d-2091-4a51-bea0-ef2f2a7d813b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.626749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9011d-2091-4a51-bea0-ef2f2a7d813b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.627146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9011d-2091-4a51-bea0-ef2f2a7d813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.659086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cef9011d-2091-4a51-bea0-ef2f2a7d813b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:31.660350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cef9011d-2091-4a51-bea0-ef2f2a7d813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:31.711138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05546c6-b3d2-4af7-970e-2b9c71840ef8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:31.748287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:31.748893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.749184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.749467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.750234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:31.750547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:31.752227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:31.753623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 380/785] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:31.755081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d95f-488b-4ddb-9247-219e9e3a5c72 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.755388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d95f-488b-4ddb-9247-219e9e3a5c72 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.755677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d95f-488b-4ddb-9247-219e9e3a5c72 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.757205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 381/786] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:31.765368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.765736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.766595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.772535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 406/787] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:31.778163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:31.786219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:31.787421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:31.871470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 382/788] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:31.872600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:31.935116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0325e-841d-4e1d-9332-a60bf6cf5fa0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:31.975246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:31.975661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:31.975950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:31.976230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:31.988006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:31.989804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:32.008492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.009600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.010702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:32.010702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:32.010702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.010702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:32.015942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 407/789] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:32.015942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.019184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1e87-40cf-42b3-a6ac-b6ea3b975fa8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.066229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.067812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.068518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.068972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.083910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:32.094294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.096118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:32.097027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:32.105214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 383/790] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:32.105214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.137252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf12e-41a0-4305-ab60-891ddf53af72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.185371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.187231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.187700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.188156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.203870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:32.214891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.216362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:32.217198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:32.219436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 408/791] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:32.220514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.225409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2519c5-1de7-44d3-a628-a2a82c5a91bc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.268643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.269586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.270071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.270550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.271765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:32.272157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.274508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.296385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 384/792] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:32.296385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.355802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7508a7-4a76-472c-862a-977d3e9312e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.403317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.404214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.404603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.404985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.406162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:32.406162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.407800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.421259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 409/793] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:32.421259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.436391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6a1c8-8474-4e9c-ab34-017c0362cbcb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.473240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.473980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.474275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.474557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.475327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:32.476008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.477097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.491995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 385/794] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:32.493105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.540332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3fb12-15f8-4a46-a132-d691354306af None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.577984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.579160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.579677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.580285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.592118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.594456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.601992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd608a-ceb2-4ec7-8484-d33681132738 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:32.611925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.613275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:31:32.614231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:32.617027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 410/795] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:32.618195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.645163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.646002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.646298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.646579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.658945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.660709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:32.679064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.680049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.680945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:32.680945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:32.680945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.680945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:32.685121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 386/796] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:32.686073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.755282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551217-2791-49cf-9af4-ece5ae5eba99 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.807484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.809785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.810389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.810802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.830069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.835222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860bd4a-4169-41e2-90f0-afc15cb363f7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:32.835498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:32.854622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:32.856715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 411/797] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:32.858808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.882044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:32.882734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.883023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.883303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.884268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:32.884591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:32.886110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333e0b-f386-4389-aef7-c2e9051a7f3e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:32.905641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 387/798] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:32.911544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09418-e25b-44df-a4a2-f4305644ec0b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:32.912047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09418-e25b-44df-a4a2-f4305644ec0b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:32.912546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09418-e25b-44df-a4a2-f4305644ec0b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:32.915415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 388/799] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:32.917074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09418-e25b-44df-a4a2-f4305644ec0b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:32.987012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f630-3e49-4922-8a98-233f7b92237f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.031897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.033819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.034262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.034720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.035904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:33.036418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.038778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.049418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09418-e25b-44df-a4a2-f4305644ec0b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.057740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 412/800] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:33.059222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.089795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.090583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.090909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.091200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.092033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:33.092346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.093814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90807-697e-44ca-a3d8-5fb97274ccea None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.106453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 389/801] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:33.107776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.108073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.108356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.131912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:33.133159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:33.193169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861841-8d96-4843-87f5-ec96f139a4ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.214773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 390/802] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:33.216047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.233621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.235027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.235563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.236125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.311635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.313177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.368682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af516a-cb09-4712-ac82-5c5ba7d1971c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.404756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.405619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.405875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.406158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.414308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.415833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:33.432984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:33.434916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 391/803] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:33.436973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.457053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 413/804] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:33.458071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.541368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae507cf-256a-4f57-9f2d-9dd4b3d61da8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.560529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92c6a5-4866-4ea6-8de7-06ff27b5c771 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.581645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.582798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.583258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.583741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.595021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.598353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.608216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.609486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.609928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.610376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.612199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.614543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:33.623893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:33.625038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:33.626021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 392/805] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:33.627135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6b79e639-23cc-4b02-8e0a-363d9275e85b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:33.635195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:33.636363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:33.637596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 414/806] 10.222.0.60 () {56 vars in 1129 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:33.639317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f579-12b5-47a6-8dae-55c2ae3ea518 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.639846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f579-12b5-47a6-8dae-55c2ae3ea518 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.640754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5f579-12b5-47a6-8dae-55c2ae3ea518 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.642461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 415/807] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:33.644087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5f579-12b5-47a6-8dae-55c2ae3ea518 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.788143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35bde-06e8-45b9-bc73-e490935dd3fe None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.802151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5f579-12b5-47a6-8dae-55c2ae3ea518 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:33.831876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.832474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.832761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.833047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.833873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:33.834183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.835655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.848326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:33.849132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:33.849423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:33.849705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:33.854196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 393/808] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:33.855041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.861842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:33.863319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:33.882411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:33.883469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:33.884513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:33.884513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:33.884513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:33.884513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:33.884513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 416/809] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:33.885555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:33.994450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799cf8-b9b0-470d-aa33-1d021b4b86f0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.022417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba6ff9-1333-470b-a427-c58975d8a8e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.030491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.031191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.031506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.031796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.032648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.033077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.035107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481e68-4bef-4581-8848-1f914b52657c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.052731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 394/810] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.054291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.054460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.055086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.058740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.059536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.059942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.060270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.061451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.061855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.063284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.069243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 417/811] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.070602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.072272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:34.073505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:34.147741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 395/812] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:34.147741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.187474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989756e-9a85-4012-abc8-8bbbd293a02d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.222262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.223077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.223396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.223673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.234563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.236082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.247520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9b6d-563e-460b-a00b-575d6aa1597e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:34.254652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:34.256354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 418/813] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:34.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.301670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.302669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.303141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.303638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.304835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.305337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.307795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.337453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 396/814] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.337453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.411081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1d305-4cad-434c-b988-854d5bad2d17 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.460538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.461352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.461640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.461929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.473438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.475480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.479741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08664cfe-b1ed-4744-ac5a-ac5047c79c38 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:34.494224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:34.495980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 419/815] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:34.497540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.521594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.522288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.522563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.522846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.523612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.523925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.525308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.530744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 397/816] 10.222.0.60 () {56 vars in 1124 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.532102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.634266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda26af1-ac6f-400a-80b3-2579f2fc6133 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.686206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f25e-d7f7-49c9-b289-cbc620872254 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.688728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.690828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.691153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.691607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] PATH_INFO: `/v3/services/network` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.692398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.693888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:34.706057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:34.708041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.710381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 420/817] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:34.712653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.729367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.730050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.730345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.730639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.731396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.731752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.733205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.746354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 398/818] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.747223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.812896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4f241-7b12-44f4-bf73-18aa3cdb04ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.849881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.850688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.850975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.851255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.858274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.859775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.873928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0a8dd-3680-48f4-8e49-e998653bf088 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:34.875275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:34.876201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 421/819] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:34.877970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:34.925077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:34.926121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:34.926579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:34.927023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:34.928306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:34.928824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:34.931264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:34.950287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 399/820] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:34.951656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.023354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682aa23-bcbf-4092-bdee-a56c7bb181d7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.074944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.076026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.076489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.076953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.078240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.081305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.100845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dfef2-3114-4f95-a471-09cc4b58665b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.111873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 422/821] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:31:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:35.113504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.171749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.172805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.173268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.174291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.175565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] RBAC: Adding query filter params (name=network) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.176079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.178598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.189416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 400/822] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.189416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.260798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e35b-4b48-48fa-9cbe-88f8759cae8d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.304177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.305611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.306148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.306632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.317210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.319917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.323261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14b78-8a31-4b9b-8695-56402a2ae380 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:35.342817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:35.343884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:35.344789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:35.345268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 423/823] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:35.346982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.371188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.372244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.372538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.372824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.373701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.374028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.375601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.393052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 401/824] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.395427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.500334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382109c6-9397-4262-b9e0-471bfe851c65 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.531804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94654dc-83d3-493d-bf00-b9685eef0267 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.539890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.540700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.540991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.541268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.549489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.550948 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:35.570824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:35.572020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:35.573132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:35.574373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.575163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.581492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 424/825] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:35.581681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.581681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.581681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.581681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.582011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.582105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.589527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 402/826] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.589527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.738304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501c420-27cf-4208-a938-da12826ef4d9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.740229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3308c-2af2-42a1-915b-2a3d479bdcef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.787399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.788091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.788389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.788677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.789053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.789492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.789812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.790571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.791201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.791291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.791923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.793596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.794306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.797072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.810691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 425/827] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.810691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.815784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 403/828] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.816794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:35.928428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036914c-1966-4609-a37b-101ba098e012 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.938363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb1f8-e004-42d7-8841-76174fd33e0b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:35.969851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.971693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.972260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.972767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.973800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:35.974328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.976117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.981117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:35.981808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:35.982098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:35.982379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:35.983160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:35.984673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:35.992648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 426/829] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:35.993970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:36.015034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 404/830] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:31:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:36.016614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:36.142356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dbe17-62dc-4d12-acb2-0dff676e4b91 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:36.190838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:36.192375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:36.192908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:36.193410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/855c179ded264256ab7868e39756b3d2/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:36.210577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=855c179ded264256ab7868e39756b3d2, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:36.212878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8d112-c863-4d7e-8878-4365b9a346d3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:36.235531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 427/831] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:35 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/855c179ded264256ab7868e39756b3d2/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:36.316119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdd8ab-7461-4a9e-b725-5771ac970972 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:36.389654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:36.390650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:36.390948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:36.391234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/e58f759fbae14125a0eb26807c8b98f5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:36.395133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=e58f759fbae14125a0eb26807c8b98f5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:36.396948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05257-d641-47dd-afbd-35cf8a6e77cf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:36.416932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 405/832] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:36 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/e58f759fbae14125a0eb26807c8b98f5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:37.528875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24a50-5686-4bcb-bbaf-68cba13460a4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:37.530081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24a50-5686-4bcb-bbaf-68cba13460a4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:37.530649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e24a50-5686-4bcb-bbaf-68cba13460a4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:37.533261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 428/833] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:37.538733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:37.539358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:37.539358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:37.557500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:37.558827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:37.638829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 406/834] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:37.663624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24a50-5686-4bcb-bbaf-68cba13460a4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:37.784397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e24a50-5686-4bcb-bbaf-68cba13460a4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:37.825605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:37.826738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:37.827218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:37.827696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:37.828549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:37.830886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:37.843764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:37.844776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:37.846566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 429/835] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:37.852297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:37.958422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be85df-cf29-414b-ab73-a82759003c70 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:37.995670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:37.996348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:37.996644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:37.996971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:37.997703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:37.998059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:37.999625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046834f3-7ee4-4617-a431-cf952408ddb0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:38.005595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 407/836] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:38.011235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:38.119472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180cf7-2521-4044-9d92-89ccb9134854 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:38.157026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:38.157713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:38.158039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:38.158337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:38.159179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:38.159523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:38.160920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430c46-9722-4177-953e-0a6857955c9a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:38.166673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 430/837] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:38.948269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0eeb-318f-4a9e-bf27-f661b64ff7f3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:38.948949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0eeb-318f-4a9e-bf27-f661b64ff7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:38.948949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0eeb-318f-4a9e-bf27-f661b64ff7f3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:38.950925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 408/838] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:38.957436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:38.958018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:38.958018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:38.976726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:38.978033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:38.979701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4edff-bf32-4658-a35b-1a02e052e9ea None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:38.979993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4edff-bf32-4658-a35b-1a02e052e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:38.980277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4edff-bf32-4658-a35b-1a02e052e9ea None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:38.981915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 409/839] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:38.990386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:38.991129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:38.991697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.012234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:39.014133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:39.053792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 431/840] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:39.080941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.106317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 410/841] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:39.134082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.204871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea32b8b-a0c3-4ff7-b30f-d73924f5a60f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.247712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.248837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.249173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.249474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.262805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-41ff9428-8b68-41ee-bdc6-434740f1364a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:39.270740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:39.272018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:39.273290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 432/842] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:39.274479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366ebf-52a1-49c6-815e-0b7e4ab7d6bc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.274479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366ebf-52a1-49c6-815e-0b7e4ab7d6bc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.274479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366ebf-52a1-49c6-815e-0b7e4ab7d6bc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.279419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 433/843] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:39.279419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366ebf-52a1-49c6-815e-0b7e4ab7d6bc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.293758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505916a-16aa-4926-a4f2-c5f0d9e4ee27 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.335074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.335991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.336283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.336567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.352795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-030856a2-642b-4301-b5f6-e9b690ec9152 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:39.364658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:39.365763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:39.366675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 411/844] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:39.368508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.368919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.369420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.395125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:39.397551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:39.408873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366ebf-52a1-49c6-815e-0b7e4ab7d6bc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.450559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.451247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.451581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.451930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.452598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:39.452913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:39.454297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:39.467731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 434/845] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:39.467731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.492876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 412/846] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:39.493224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.594868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c82459-ffdd-4a36-8dfc-bde8875cfa76 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.615816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a67c47-6eae-42a7-8759-0b83b1f5da53 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.636397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.637089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.637998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.638963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:39.639445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:39.641143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:39.657004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 435/847] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:39.657004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.669195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.670731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.670906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.671182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.683352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:39.684842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:39.703666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:39.704634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:39.705657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:39.705657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:39.705657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:39.705657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:39.705657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 413/848] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:39.706870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.789899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de879b-da41-4377-8897-45b69ba4217a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.831192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.832266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.832794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.833232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8baac66-1665-4985-bf6b-a76955c2d975 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:39.833963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.834949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:39.839545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:39.858675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:39.860290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:39.862177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:39.865263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 436/849] 10.222.0.60 () {56 vars in 1132 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:39.867477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:39.885998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:39.886906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:39.887259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:39.887625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:39.899143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:39.901699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:39.926311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:39.927297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:39.928243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:39.928243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:39.928243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:39.928243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:39.933550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 414/850] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:39.933550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.003129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c76dd-c22a-4718-b383-f461c4b0d17d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.045254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.045936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.047155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.047155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.047464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:40.047620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.049557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.070416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 437/851] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:40.070416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.085520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36aa66-6977-4365-9ed2-1172c0e63a9c None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.128265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.129055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.129195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.129408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.130106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:40.130492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.131817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.137774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 415/852] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:40.138151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.209749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3e210-7a11-40ac-acb0-19801ca09205 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.263442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.264397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.265028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.265496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.266764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:40.267914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.270265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.295634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 438/853] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:40.295634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.297197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e11dfe-173a-4f9a-86d2-ee68ce20dfd1 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.339547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.341124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.341750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.342385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.353463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.356245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:40.381905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:40.383914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 17:31:40.385747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:40.397503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 416/854] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:40.397503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.420754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9db0-1dca-4976-b8ad-a94c447bfd54 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.459984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.460672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.460957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.461237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.461967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:40.462280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.463712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.479418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 439/855] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:40.479418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.583609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b470-6ec8-45d1-9b62-52ba572857cf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.588641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01867a2a-41c0-49d3-b89e-5a465cb9c14c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.631242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.632090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.632308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.632591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.633480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:40.633797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.635316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad149e-9665-47e0-bc8c-22610ac27432 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.656828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.658735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.659168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.664867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 440/856] 10.222.0.60 () {56 vars in 1135 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:40.665083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.665169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42956-0b88-4816-bdbb-c73795e323e7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.665169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42956-0b88-4816-bdbb-c73795e323e7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.665169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42956-0b88-4816-bdbb-c73795e323e7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.665169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 441/857] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:40.666041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42956-0b88-4816-bdbb-c73795e323e7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.678133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.679680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ceebfefb-a2b3-4dc9-b290-96e33bd50d63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:40.707326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:40.709551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:40.711020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 417/858] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:40.713590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.714017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.714933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.742428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:40.744087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:40.818637 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42956-0b88-4816-bdbb-c73795e323e7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:40.871435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 418/859] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:40.871435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:40.874340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:40.875155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:40.875598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:40.876156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:40.973581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:40.975196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.000584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b303fc-16d7-49a6-bd43-5ec43c18e2ab None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.041988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.042757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.043049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.043321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.044416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:41.044769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.046478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.075441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 419/860] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:41.075441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.104006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 442/861] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 17:31:41.109379 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.216787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848c7bd-e042-44ca-a2e1-bc9b1f9fc08b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.237925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6b250-dc2b-4c2e-bd7f-46f1212afe6f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.268691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.269991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.270371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.270916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.271877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.273902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.288427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.289865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.290660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.291343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.293186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 420/862] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:41 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:41.294114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.382118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.385189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.448788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db404903-8b7d-433d-89b7-efa50c88242a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.497951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.498818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.499179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.499587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.516340 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.518266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.543073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 443/863] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:41.545060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:41.549899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:41.551349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:41.553021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:41.553021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:41.553021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:41.553021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:41.555641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 421/864] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:41.563349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.691250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e18c7-dc1f-4094-a8c0-75cfa5ef5930 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.695578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9c597-1d37-40a0-a550-e0b0a0e9081f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.735691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.738320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.739247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.740189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.740985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.741743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.742033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.742321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.743241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:41.743657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.745466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.757263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.759669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:41.761732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 422/865] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:41.768637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:41.789557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:41.791246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:41.793451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:41.793451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:41.793451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:41.793451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:41.793451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 444/866] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:41.797586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:41.939244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa548c4-d285-4614-a0d3-0e63afdee3ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.965882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af85af-e249-4167-ae06-f934e31aa070 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:41.988605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:41.989990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:41.990575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:41.991234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:41.992526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:41.993264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:41.996203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.010900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 445/867] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:42.017302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:42.023397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.023799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.024067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.024348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.033920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.036144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:42.055998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:42.056980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:42.058472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:42.063576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 423/868] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:42.065723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:42.142055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17338be-ac18-4edc-88f4-3b8f4039addd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:42.182997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.184403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.184935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.185476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.194084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.196064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.202249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89e8d2-105f-4295-8d38-e6732fdb47fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:42.213040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:42.214147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:42.215129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:42.223482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 446/869] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:42.225488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:42.250586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.251289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.251739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.252085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.253263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:42.253813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.255802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.278062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 424/870] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:42.280560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:42.343238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcbbc5-58a3-45e8-b0e0-9fff0ae11557 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:42.383006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.384178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.384716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.385236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.386363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:42.386881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.388695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.411523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 447/871] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:42.416402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:42.425500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ca911-b40e-408d-9ab4-6d66d9ff1656 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:42.505103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.506292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.506789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.507259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.508861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=e58f759fbae14125a0eb26807c8b98f5) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:42.509414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.512198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4c7da-052d-4d17-8ffe-5c598a819efb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.523296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 425/872] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:42 2022] GET /identity/v3/role_assignments?user.id=e58f759fbae14125a0eb26807c8b98f5&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:42.576731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660de1-bfe9-481f-956e-22b176969401 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:42.626502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:42.627950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:42.628626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:42.629197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:42.630635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=855c179ded264256ab7868e39756b3d2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:42.631341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:42.633482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6a42-7dd2-4559-9f95-e35cce7324d4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:42.647518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 448/873] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:42 2022] GET /identity/v3/role_assignments?user.id=855c179ded264256ab7868e39756b3d2&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:43.329980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237507-d2a3-4f22-82a1-114a05add973 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:43.331166 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237507-d2a3-4f22-82a1-114a05add973 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:43.331276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237507-d2a3-4f22-82a1-114a05add973 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:43.333026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 426/874] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:43.338799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ee90-6dc3-423d-9b89-ee7627cd228d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:43.339354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ee90-6dc3-423d-9b89-ee7627cd228d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:43.339354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33ee90-6dc3-423d-9b89-ee7627cd228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:43.359696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0e33ee90-6dc3-423d-9b89-ee7627cd228d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:43.361842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0e33ee90-6dc3-423d-9b89-ee7627cd228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:43.449174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 449/875] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:43.474196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6237507-d2a3-4f22-82a1-114a05add973 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:43.600763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6237507-d2a3-4f22-82a1-114a05add973 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:43.644087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:43.644790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:43.645077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:43.645355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:43.646164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:43.647856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319494a-48cf-4476-a7a2-7d76c8a4396b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:43.663857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 427/876] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:43 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:44.214814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70014e-fc19-4c7f-81ea-2f99bc74c914 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:44.215098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70014e-fc19-4c7f-81ea-2f99bc74c914 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:44.215463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70014e-fc19-4c7f-81ea-2f99bc74c914 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:44.217063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 450/877] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:44.223627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:44.223912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:44.224201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:44.242395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:44.243621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:44.327081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 428/878] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:44.359787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70014e-fc19-4c7f-81ea-2f99bc74c914 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:44.518167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70014e-fc19-4c7f-81ea-2f99bc74c914 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:44.575520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:44.576911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:44.577428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:44.577942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:44.579264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:44.582662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:44.602681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:44.604439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:44.605339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 451/879] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:44.612013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:44.765956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd20e7d-e688-4956-9e5c-bc0e6c2df779 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:44.820281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:44.820896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:44.821182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:44.821466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:44.822225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:44.822539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:44.824142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:44.830349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 429/880] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:44.835735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:44.953893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831aa35-5c6a-4855-bc99-f3db9d026db5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:44.995917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:44.997141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:44.997745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:44.998103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:44.998972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:44.999289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:45.001115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:45.008456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 452/881] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:45.016646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.140472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79299c-22a1-4012-aed0-28daa264f5d0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:45.199291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:45.200059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.200368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.200661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.201519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] RBAC: Adding query filter params (interface=public, service_id=ffa8b8adf0304cfface879cec91c01be, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:45.201838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:45.203263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb7867-d295-493f-b127-ac5f929975b4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:45.211515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 430/882] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/endpoints?service_id=ffa8b8adf0304cfface879cec91c01be&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:45.216904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.266108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0869b-a5ea-4a37-a20d-2812d22f1ddb None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.266564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0869b-a5ea-4a37-a20d-2812d22f1ddb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.267542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0869b-a5ea-4a37-a20d-2812d22f1ddb None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.269977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 431/883] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:45.275855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.276201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.276555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.299885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:45.302562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:45.370576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e382a-1767-48e8-9403-2849c60628c4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:45.419003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 432/884] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:45.454096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:45.456402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.457057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.457794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.459230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:45.461866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767729d-caca-4654-8a05-b37fbaecab0f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:45.465626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.473123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 453/885] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/services => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:31:45.550269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66e6b-9324-46d0-9e78-1b0cb3bfadeb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.550963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66e6b-9324-46d0-9e78-1b0cb3bfadeb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.551591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc66e6b-9324-46d0-9e78-1b0cb3bfadeb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.555915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 454/886] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:45.562768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.563487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.566253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.592602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:45.595893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:45.632256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3197106-b05c-477e-8756-265377bb51c1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:45.676046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:45.676822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.677112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.677393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.678089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:45.679612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:45.694303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:45.696010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:45.702706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 433/887] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:45.706933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.724018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 455/888] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:45.748231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.831067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9a44-1526-45dc-ba3f-4931441ba225 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:45.870447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:45.871587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.872059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.872485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.873388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:45.873863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:45.875450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:45.878459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdd51b-3636-446d-9971-e2a3201f34e9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:45.882196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 434/889] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:45.891717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:45.929806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:45.930648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:45.931068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:45.931402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:45.946276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:45.956272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:45.957870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:45.959175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:45.963671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 456/890] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:45.965392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.038267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e067b-e4bf-4c56-ac37-29459639c2e9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.075907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.076873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.077331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.077748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.078634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:46.079101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.080933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.086823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 435/891] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:46.098195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995db93-6382-443f-ac01-00fee668a574 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.139514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.140629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.141090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.141553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.143260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:46.143781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.145538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81a82b-e919-4130-bde8-83f68ddd6c94 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.156217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 457/892] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:31:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:46.169717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.311830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ab6ca-58e3-4687-89c4-60e9c308bbfe None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.350501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c59d-e595-4f25-b9b6-0d5a23a9d3da None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.351147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c59d-e595-4f25-b9b6-0d5a23a9d3da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.351665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c59d-e595-4f25-b9b6-0d5a23a9d3da None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.353635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 458/893] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:46.358442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.359585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.359901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.360166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.360297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.360938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.361429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.377550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.379700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.381067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:46.383051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:46.408860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:46.410079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:46.411209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:46.411209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:46.411209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:46.411209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:46.415455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 436/894] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:46.418977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.485792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 459/895] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:46.515870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.559705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1981d2-6c73-439a-93e0-55835e114f3e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.615670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.616942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.617379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.617801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.619021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:46.619705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.621377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.641029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 437/896] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:46.644284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.653546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f13c3-c483-4dc1-81a3-7a8229108673 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.700343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.701238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.701528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.701806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.702483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.703942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:46.722229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:46.723275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:46.724672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 460/897] 10.222.0.60 () {56 vars in 1132 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:46.732107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.775098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aec75-63f0-4579-81ad-07d7a87ecd73 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.839587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.840975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.841692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.842461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.855998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.858877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.871898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9476c-753b-4ffc-a333-c29eed6fedce None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:46.885434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:46.886689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:46.888270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:46.897455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 438/898] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:46.899559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:46.920553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:46.921808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:46.921944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:46.922254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:46.924306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:46.924782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:46.926720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:46.939616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 461/899] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:46.941907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.029654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ab014-01f5-4bf4-a6fc-0647d8cb71b3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.068039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.068611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.068869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.069147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.070013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:47.070396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.071908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.098782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 439/900] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:47.099744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.117846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63ccc2-4809-4be3-b396-b1101f511366 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.189237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.190614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.191151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.191613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.192772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:47.193259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.195864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.211444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 462/901] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:47.218771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.247023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaced19-9790-4362-aa86-57b332cc50fc None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.304328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.305467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.305943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.306373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.421751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.423545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.425823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6455-546a-46cf-861a-2d04f2d3fe23 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.491177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.492824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.493632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.494388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.496350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] RBAC: Adding query filter params (interface=public, service_id=7a996ea34e5048f98afad494cd63fbe7, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:47.497211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.499963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.516251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 463/902] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/endpoints?service_id=7a996ea34e5048f98afad494cd63fbe7&interface=public®ion_id=RegionOne => generated 194 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:47.521034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.552696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 440/903] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:47.554583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.676083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1508-0dc5-4684-bba1-15de0c0a637b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.717404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.718252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.718537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.718810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.726008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0131a1-cba6-4ce2-ada1-3cd34a41a98f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.731917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.733462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:47.754191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:47.755113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:47.756033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:47.756033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:47.756033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:47.756033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:47.760220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 441/904] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:47.761745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:47.781136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.782305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.783400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.783918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.785062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.786804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.799571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 464/905] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/services => generated 1268 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:31:47.885114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ed8c5-d5e3-4d7c-b36d-4f28e57378fa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:47.936750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:47.937737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:47.938182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:47.938637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:47.940885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:47.941412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:47.943868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01fa2c-2543-47f2-b045-d198e586b821 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:47.969585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 442/906] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:47.972315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.102600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f810d4-21a9-4b1c-9602-849c1042c3ae None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.107281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ce85-f355-459c-99a0-f9e1f43d51d8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.107625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ce85-f355-459c-99a0-f9e1f43d51d8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.107907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ce85-f355-459c-99a0-f9e1f43d51d8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.109568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 443/907] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:48.115869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.116174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.116447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.134974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:48.136275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:48.149692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.150523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.151184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.151505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.159806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.161274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:48.176596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:48.177543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:48.178470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 465/908] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:48.185421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.223264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 444/909] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:48.246265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.308678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd78ae0-8f67-4b0d-9396-fe7a898cad26 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.354573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.355274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.355599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.355881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.356854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:48.357169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.359237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.360685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f55c-2a86-412f-a6a1-96cdd533be30 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.374483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 466/910] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:48.380266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.410786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.411810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.412359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.412733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.413848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.415847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:48.431929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:48.433248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 17:31:48.434350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:48.436692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 445/911] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:48.443163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.519342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb009f7e-8f30-41ff-bb70-55341b82fcc7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.548592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1bd8-08e4-49aa-b5e9-93cb3f1c4f22 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.561864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.562569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.562861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.563172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.564804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] RBAC: Adding query filter params (role.id=6158cdc2c196407eb95a7f974f4d036f, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=855c179ded264256ab7868e39756b3d2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:48.565407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.567033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.573597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 467/912] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:48 2022] GET /identity/v3/role_assignments?user.id=855c179ded264256ab7868e39756b3d2&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=6158cdc2c196407eb95a7f974f4d036f => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:48.598156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.598884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.599287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.599614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.600552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:48.600887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.602480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.609149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 446/913] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:48.615671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.739123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f907-04b1-4de8-8d34-915b2e8b3bed None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.776635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.777315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.777601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.777878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.778589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:48.778896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.780301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a7a4-eed5-4739-9907-07a42997aa03 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.785965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 468/914] 10.222.0.60 () {56 vars in 1114 bytes} [Tue May 10 17:31:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:48.791308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:48.835521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36226ce-1bb4-414d-a4cc-92b778f06b4f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.835844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36226ce-1bb4-414d-a4cc-92b778f06b4f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.836129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36226ce-1bb4-414d-a4cc-92b778f06b4f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.837695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 469/915] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:48.843484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.844050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.844552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.864052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:48.866058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:48.905113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280f3c3-8cee-498d-996b-c20aacbfacf3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:48.939860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:48.940841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:48.941128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:48.941460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:48.942228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:48.943637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340f49c-b570-4528-9e0f-c4ddcbd4adc6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:48.950536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 470/916] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:48.969554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 447/917] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:31:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:48.974556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:49.108954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c923-645f-4dea-bb3b-293d8b11d67e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:49.156052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:49.156639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:49.156923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:49.157197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:49.158016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:49.159641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a419ed-49df-418b-8266-3432c59f0bf7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:49.174809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 471/918] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:48 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:50.288121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a707-a19e-4fb0-97d7-6c5467295bd2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.289033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a707-a19e-4fb0-97d7-6c5467295bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.289473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6a707-a19e-4fb0-97d7-6c5467295bd2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.291255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 448/919] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:50.296503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.296967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.297261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.315359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:50.316607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:50.407291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 472/920] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:50.430282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6a707-a19e-4fb0-97d7-6c5467295bd2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:50.536832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6a707-a19e-4fb0-97d7-6c5467295bd2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:50.571632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:50.572374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.572662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.572940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.573608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:50.574972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:50.590201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:50.591219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 17:31:50.592103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:50.593682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 449/921] 10.222.0.60 () {56 vars in 1132 bytes} [Tue May 10 17:31:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:50.598479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:50.713495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2604d9b-4658-4f0a-8b92-174a92b8597f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:50.747612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:50.748298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.748583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.748859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.749603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:50.749916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:50.752067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:50.758609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 473/922] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:50.764220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:50.877989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5425f-13bc-4851-a0c7-bc159a1ab194 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:50.912855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:50.913538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.913826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.914103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.914825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:50.915133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:50.916673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47affb8c-315c-414c-b565-8b3bd662c1d7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:50.922256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 450/923] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:50.927859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:50.957072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7825-f92e-4e80-b618-cd7fe9d63fd2 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.957801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7825-f92e-4e80-b618-cd7fe9d63fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.958283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b7825-f92e-4e80-b618-cd7fe9d63fd2 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.960210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 451/924] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:50.965846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:50.966419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:50.966919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:50.984015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:50.985549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:51.042725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d76ac-1f7c-4585-955a-1a3dadcbc898 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.066230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 452/925] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:51.086765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.088041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.088498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.088693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.089285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.090249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.093060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.123569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 474/926] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:31:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:51.209121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09c5b-7aa4-40ec-9b93-2d65aa2bce0d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.255006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.255880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.256168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.256444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.269434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4eb485f5-42fd-4fe3-a139-c462127a26f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:51.278110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:51.279125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.280018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 453/927] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:51.286195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.366588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa9ec-e60f-41d3-9b0b-35a893e1e493 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.367101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa9ec-e60f-41d3-9b0b-35a893e1e493 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.367101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fa9ec-e60f-41d3-9b0b-35a893e1e493 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.369626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 454/928] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:51.375014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.375419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.375775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.396550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:51.398461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:51.409204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fefaf-de5e-45a0-9b68-e15de2298d10 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.447300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.448121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.448567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.448920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.449752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:51.450165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.451662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.461306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 475/929] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:51.467770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.488764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 455/930] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:51.519135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.587640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4c04-8231-49d5-a000-20eac489971d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.629843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.631240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.631806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.632241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.632358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c510a-8b5b-4149-b7c6-fe7939083121 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.648787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.651090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.668455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.669225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.669582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.669948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.670778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.672317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-158994d2-11e8-463d-a584-cb1d4c8646ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:51.672465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:51.673455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:51.674349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:51.674349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:51.674349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:51.674349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:51.679219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING keystone.server.flask.common [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 17:31:51.679302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 476/931] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:51.679302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c26a-4593-4ea4-ab75-f13e2bf76ed4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.679302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c26a-4593-4ea4-ab75-f13e2bf76ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.679302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840c26a-4593-4ea4-ab75-f13e2bf76ed4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.679302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 477/932] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:51.681302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c26a-4593-4ea4-ab75-f13e2bf76ed4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.698914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.sql.core [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 17:31:51.698914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 17:31:51.698914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [parameters: {'id': 'f6cc9f0e4e59444482e2326f02b41de1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 17:31:51.698914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80255) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-8af72b31-a200-45af-aee3-72b23f7d3e02 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cc9f0e4e59444482e2326f02b41de1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cc9f0e4e59444482e2326f02b41de1. May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:31:51.717304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 17:31:51.718197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application yield resource May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application next(self.gen) May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.rollback() May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.force_reraise() May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise self.value May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application session.commit() May 10 17:31:51.719142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._prepare_impl() May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.session.flush() May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._flush(objects) May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application compat.raise_( May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application flush_context.execute() May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 17:31:51.720112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rec.execute(self) May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 17:31:51.721065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application conn.query(q) May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application result.read() May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:31:51.721868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [parameters: {'id': 'f6cc9f0e4e59444482e2326f02b41de1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.722815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:51.723644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6cc9f0e4e59444482e2326f02b41de1. May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.724573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 456/933] 10.222.0.60 () {60 vars in 1140 bytes} [Tue May 10 17:31:51 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:51.725836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.726133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.726418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.744848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:51.746401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:51.805797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840c26a-4593-4ea4-ab75-f13e2bf76ed4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.818304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 457/934] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:51.819144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.853907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.854582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.854873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.855153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.855949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:51.856268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.857682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.870045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 478/935] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:51.875204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:51.921755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8621aa-ec4b-4bad-9e2f-887339b0c349 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.965377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:51.966195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:51.966485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:51.966775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:51.974480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:51.976180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:51.977039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add36b7-18b2-4561-a5b5-70c9d47957c3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:51.991173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:51.992297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:51.993202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 458/936] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:51.993854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.016491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.017848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.018146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.018426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.019092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.020536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:52.033295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:52.034342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:52.035168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:52.039593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 479/937] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:52.040312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.099154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88e539-3c7f-4f19-b5ef-89144cf1bb12 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.132561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.133378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.133668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.133947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.143988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.145637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.156069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3fb29-f869-4988-bb27-d81258037f8c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:52.161761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:52.162757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 459/938] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:52.168819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.197908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.198496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.198783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.199062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.199885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.200196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.201631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.223156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 480/939] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:52.224407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.287463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bb29b-a29d-4d1c-83e9-f29e9036e227 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.328544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.329942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.330260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.330543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.331513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.331833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.333345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.342630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 460/940] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:52.351925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.363663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b046c-da26-40ec-a65b-955291877ae9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.407827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.408906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.409415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.410377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.411491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.412013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.413777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.438489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 481/941] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:52.440838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.479435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d4448-7a8a-4e4d-a660-38e47ff18b62 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.527627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ebe77-1766-4f03-a746-566027887025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.528354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ebe77-1766-4f03-a746-566027887025 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.528642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ebe77-1766-4f03-a746-566027887025 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.528923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ebe77-1766-4f03-a746-566027887025 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.529654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ebe77-1766-4f03-a746-566027887025 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.530081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ebe77-1766-4f03-a746-566027887025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.531643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ebe77-1766-4f03-a746-566027887025 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.540336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 461/942] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:52.545959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ebe77-1766-4f03-a746-566027887025 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.568799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7eb23-209e-48e3-8a72-2f63dcc70eac None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.635229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.636628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.637034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.638557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.659141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.662006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.675424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ebe77-1766-4f03-a746-566027887025 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:52.690906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:52.691916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:52.692825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:52.692825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:52.692825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:52.692825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:52.692825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 482/943] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:52.698249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.728085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.728874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.729364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.729720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.731018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] RBAC: Adding query filter params (interface=public, service_id=c01697b07eb0413bb913a22ba8e51e0f, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.731410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.733189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.743067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 462/944] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/endpoints?service_id=c01697b07eb0413bb913a22ba8e51e0f&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:52.748668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.816487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754e67-8baf-4527-a41e-d388a1948fe4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.860416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.861791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.862320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.862694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.863485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:52.863802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.865384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.883447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 483/945] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:52.885127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:52.894921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7b3cd-e628-4c4e-8865-37ce24afa599 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:52.930716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:52.931678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:52.932118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:52.932568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:52.933418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:52.935029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:52.942585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 463/946] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:31:53.014424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c4e5-3c75-4236-ae5e-10e528429fe4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:53.053894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:53.055183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.055710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.056238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.066410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:53.069271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:53.088361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:53.089335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:53.090247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:53.092937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 484/947] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:53.106258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:53.238625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9d19a-dab1-471b-8b45-822c8fb4ada2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:53.277245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:53.278290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.278798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.279280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.280316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:53.280827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:53.282529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e991f5-75b1-47d4-93b7-d78389384222 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:53.296464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 464/948] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:53.302766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:53.420743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76399-b034-4909-b442-64a9cbb06d91 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:53.469798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:53.471453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.471976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.472485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/855c179ded264256ab7868e39756b3d2/roles/6158cdc2c196407eb95a7f974f4d036f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.475031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=855c179ded264256ab7868e39756b3d2, role_id=6158cdc2c196407eb95a7f974f4d036f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:53.476727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a3c17-4ef8-457d-ae8c-a122dd77e9d3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:53.492612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 485/949] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:31:53 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/855c179ded264256ab7868e39756b3d2/roles/6158cdc2c196407eb95a7f974f4d036f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:31:53.550430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b93c8-1ae5-4841-af16-9e6cc6bcb250 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.550936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b93c8-1ae5-4841-af16-9e6cc6bcb250 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.550936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b93c8-1ae5-4841-af16-9e6cc6bcb250 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.552777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 465/950] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:53.558848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.559243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.559941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.588831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:53.590097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:53.669154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 486/951] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:53.692490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b93c8-1ae5-4841-af16-9e6cc6bcb250 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:53.822525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b93c8-1ae5-4841-af16-9e6cc6bcb250 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:53.858268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:53.859090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:53.859392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:53.859685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:53.860360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:53.861979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:53.874592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:53.877650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:53.879684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 466/952] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:53.886641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:53.987581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c553-eb94-4ac6-bcbd-6f2733a044af None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:54.022184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:54.022858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:54.023141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:54.023442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:54.024164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:54.024474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:54.025842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f102ec-f177-4201-94ca-91a4767e3b1a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:54.031380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 487/953] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:54.037000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:54.141189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d0a43-ffa5-4baf-a5cb-b51fa6a28502 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:54.176850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:54.177541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:54.177831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:54.178115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:54.178844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:54.179156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:54.180564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cce2c-f3f3-4beb-ba92-9caef2606db1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:54.185676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 467/954] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:54.824692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9ea5-9d4b-432a-ad27-186b9bd2e191 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:54.824692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9ea5-9d4b-432a-ad27-186b9bd2e191 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:54.824692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b9ea5-9d4b-432a-ad27-186b9bd2e191 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:54.825690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 488/955] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:54.845636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:54.846846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:54.847453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:54.868617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:54.870968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:54.951543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 468/956] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:54.977868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9ea5-9d4b-432a-ad27-186b9bd2e191 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.085479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b9ea5-9d4b-432a-ad27-186b9bd2e191 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:55.120628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:55.121359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.121656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.121936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.122659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:55.124133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:55.125456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING keystone.server.flask.common [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 17:31:55.138596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.sql.core [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 17:31:55.138596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 17:31:55.138596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [parameters: {'user_id': 'bbdaaa76ca65432289c3fd8ebb503a9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 17:31:55.138596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80254) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 10 17:31:55.146732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:31:55.147696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application yield resource May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.rollback() May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.force_reraise() May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise self.value May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application session.commit() May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 17:31:55.148634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._prepare_impl() May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.flush() May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._flush(objects) May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application compat.raise_( May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application flush_context.execute() May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rec.execute(self) May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 17:31:55.149528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 17:31:55.150411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 17:31:55.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bbdaaa76ca65432289c3fd8ebb503a9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:55.154024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 17:31:55.155895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.158083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 489/957] 10.222.0.60 () {60 vars in 1131 bytes} [Tue May 10 17:31:54 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:55.167248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.280642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e64d7-7a9b-4d8a-a299-39277a8d78a8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:55.318116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:55.318922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.319208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.319518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.327228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:55.328708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1673c9ca-f2ca-4092-88d6-b9f3ef41a670 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:55.344395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:55.346060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:55.347087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 469/958] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:31:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:55.354415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.462327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c3c-3f95-4f72-8fac-3a4c1ec7204b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.462694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c3c-3f95-4f72-8fac-3a4c1ec7204b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.462899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24c3c-3f95-4f72-8fac-3a4c1ec7204b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.464666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 470/959] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:55.469809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.470837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.471126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.473232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c6c4a-5744-4788-b309-434c0f2738f8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:55.488943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:55.490130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:55.510080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:55.511173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.511704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.512204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.513244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:55.513772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:55.515701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:55.557400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 490/960] 10.222.0.60 () {56 vars in 1101 bytes} [Tue May 10 17:31:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:55.567734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 471/961] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:31:55.594367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.716670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3bc7e-b80c-4d3c-ad9e-beb4f0516cea None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:55.756329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:55.757182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.757475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.757762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.758454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:55.759963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:55.773995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:55.775104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:55.776110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 491/962] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:55.781545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.894287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714cf68-7e96-444c-92d5-edc9aa3bcf48 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:55.929664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:55.930348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.930641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.930926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.931683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:55.931998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:55.933367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709585da-393f-49ba-8c31-8e9293a868da None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:55.938304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 472/963] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:55.944560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:55.962288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d840-2474-4847-acee-d6b11c037237 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.962602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d840-2474-4847-acee-d6b11c037237 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.962838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d840-2474-4847-acee-d6b11c037237 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.964373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 473/964] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:55.969367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:55.969601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:55.970406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:55.986586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:55.987819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:56.050549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efde6d9-9f28-41d7-9e0d-c5151886723d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.077572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 474/965] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:56.090371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.091053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.091341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.091652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.092376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:56.092689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.094070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.104432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 492/966] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:56.105592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.105708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.216513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088f58b-ae11-4a54-a2a8-924074d40dac None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.227877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85d38-46bb-40ed-8a18-4d7a70a73734 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.254360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.255183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.255503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.255783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.265507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.266105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:31:56.266296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.266574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.267067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.267917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.269303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:31:56.274353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:56.275605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:56.276821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 493/967] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:31:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:56.281361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.294138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 475/968] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:31:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:31:56.410224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1152fb-a582-4cce-9c08-508782d70a6a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.459221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.459938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.460222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.460533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.461377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:56.461713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.463206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3aaa9-072e-4a49-ac34-4b2a6f9e7024 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.478175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 494/969] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:31:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:56.479248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.590877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e9b35-02ef-4e8e-a464-b97246abcdfa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.629970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a927f-f585-4fec-90eb-438ee214a3ac None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.630240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a927f-f585-4fec-90eb-438ee214a3ac None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.630526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a927f-f585-4fec-90eb-438ee214a3ac None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.635418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 495/970] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:56.636787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.638385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.638678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.639195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.640052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.640739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.641243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.654744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.656343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.663017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:56.664910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:56.678846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:56.679944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:56.680874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:56.680874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:56.680874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:56.680874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:56.680874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 476/971] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:56.685980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.762882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 496/972] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:56.789161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.830008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c85de-75f0-4d04-a829-0fae05c86f64 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.874989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.875887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.876743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.877025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.877774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:56.878086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.879501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.897394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 477/973] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:56.898651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:56.931318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e3a4e-dbcc-4e1e-858d-2be0d01c80e9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:56.968679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:56.969508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:56.969883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:56.970157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:56.970904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:56.972331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:56.987116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 497/974] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:31:56 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:31:57.012696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa104e7-9696-4367-bee1-ec6be2673f17 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:57.059456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:57.060233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:57.060522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:57.060797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:57.069859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:57.071397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:31:57.088943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:57.090015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:57.090959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 478/975] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:31:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:57.096872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:57.228267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477a9f1-5d0c-4b4f-866f-f0eec457dae9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:57.278314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:57.279010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:57.279300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:57.279617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:57.280491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:57.280803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:57.282764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:57.304732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 498/976] 10.222.0.60 () {56 vars in 1149 bytes} [Tue May 10 17:31:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:57.310473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:57.437891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38cb5-71fa-485d-8ced-c986cc900778 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:57.479917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:57.480879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:57.481217 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:57.481603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:57.571300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:57.572826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:57.691384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 479/977] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:31:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:31:57.697848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:57.816759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eccb3ff-6866-4c18-a3f2-4561534e4854 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:57.853146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:57.854007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:57.854238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:57.855484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:57.867727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:57.869223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:31:57.888893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:57.896127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:57.898457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:31:57.898457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:31:57.898457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:31:57.898457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:57.898457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 499/978] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:57.902434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:58.010538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df959c-57af-42f7-b86c-82469349b629 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:58.055854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:58.056969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.057467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.057925 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.059358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:58.059895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:58.062621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:58.077744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 480/979] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:58.083705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:58.208556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9103c91-dd99-40b0-bd7a-f336102e055b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:58.249487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:58.250287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.250569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.250843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.263713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:58.265179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:31:58.280430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:58.281504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:31:58.283166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:58.286525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 500/980] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:31:58.287910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:58.404764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975e391-0f9e-4b3c-8fd4-f7272c3866b7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:58.448360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:58.448360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.448674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.448921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.449731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:58.450049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:58.451560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24db321-74bc-4c02-b2d0-358b49f75818 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:58.467035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 481/981] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:58.473531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:58.589035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11fa5-1867-41f4-a955-3e7ee31c3a6f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:58.627672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:58.628345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.628635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.628916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.629761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] RBAC: Adding query filter params (role.id=6158cdc2c196407eb95a7f974f4d036f, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=855c179ded264256ab7868e39756b3d2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:58.630080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:58.631543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce123-ab1d-4a1b-b339-b4774fc35360 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:58.647400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 501/982] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:31:58 2022] GET /identity/v3/role_assignments?user.id=855c179ded264256ab7868e39756b3d2&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=6158cdc2c196407eb95a7f974f4d036f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:58.727499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f8a9e-5436-4dd6-b9d6-72aeb8e0a270 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.727700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f8a9e-5436-4dd6-b9d6-72aeb8e0a270 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.728000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f8a9e-5436-4dd6-b9d6-72aeb8e0a270 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.729617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 482/983] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:31:58.735608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:58.736615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:58.736615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:58.755035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:58.756305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:58.837123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 502/984] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:58.859876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f8a9e-5436-4dd6-b9d6-72aeb8e0a270 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:58.980260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f8a9e-5436-4dd6-b9d6-72aeb8e0a270 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.015711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.017397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.017511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.017724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.018454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.019921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:59.032840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:59.034733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:31:59.036244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 483/985] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:31:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:59.040668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.163724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e517c6-9f34-4adc-8dd1-1ae6113ed1d2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.209030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.209927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.210345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.210761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.211741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:59.212206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.213794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90684a4-f36b-47d5-b33a-c02ea910cf3e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.220387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 503/986] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:59.225892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.351065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84368342-1114-4d8c-86cf-c0dcb7afcaca None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.388238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ba63-ecb5-4041-a97f-8a1242deb068 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.388495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ba63-ecb5-4041-a97f-8a1242deb068 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.388783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560ba63-ecb5-4041-a97f-8a1242deb068 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.390168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 504/987] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:31:59.392282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.393045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.393331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.393606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.394329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:59.394640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.396060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.397090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.397390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.397697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.403298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 484/988] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:31:59.409737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.416556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:31:59.417770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:31:59.495850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 505/989] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:31:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:31:59.518298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.519464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b490-5e61-402c-a2d4-6e22a19fba5e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.570165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.570855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.571146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.571455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.572311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] RBAC: Adding query filter params (interface=admin, service_id=c01697b07eb0413bb913a22ba8e51e0f, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:59.572657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.573994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.579985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 485/990] 10.222.0.60 () {56 vars in 1249 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/endpoints?service_id=c01697b07eb0413bb913a22ba8e51e0f&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:59.585279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.650233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95d60-6600-4b69-bf1a-46bb0d7733a5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.695773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.696341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cbe8-f8d6-421d-8a02-1b536e158b95 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.696599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.696859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.697140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.697816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.699221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:31:59.711400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:31:59.712593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:31:59.713505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 506/991] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:31:59.718795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:31:59.736438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.737233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.737523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.737801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.738490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.739918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.747399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 486/992] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:31:59.846822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55699c5-e46f-4414-9579-7a8be280a731 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:31:59.889718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:31:59.890416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:31:59.890704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:31:59.890986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:31:59.892364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:31:59.892681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:31:59.894128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:31:59.905112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 507/993] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:31:59.906902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:00.046499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866d37-a5c3-48e2-a134-aea03c54bfe0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:00.084076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:00.084754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:00.085044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:00.085324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:00.086045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:00.086359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:00.087783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:00.098418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 487/994] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:31:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:00.100159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:00.198095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6fa43-2b4d-4f63-917e-fd1401460b2b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:00.230774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:00.231473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:00.231769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:00.232051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:00.232855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] RBAC: Adding query filter params (interface=public, service_id=7ff8d278dc1a4954b20b55ff1ea7e259, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:00.233178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:00.234581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adb5e9-a822-42d1-9b7f-a38919b86ff6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:00.244476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 508/995] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:32:00 2022] GET /identity/v3/endpoints?service_id=7ff8d278dc1a4954b20b55ff1ea7e259&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:00.246088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:00.348248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1735b-7129-4e42-aa46-4a32d2f63d29 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:00.382474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:00.383158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:00.383531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:00.383933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:00.384535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:00.385903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a2be-516a-4e44-9b8d-0d1965067b38 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:00.399696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 488/996] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:32:00 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:32:01.049646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de8e4-35ec-4ba9-bfef-2f0c71a2c2ea None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:01.049974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de8e4-35ec-4ba9-bfef-2f0c71a2c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:01.050224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598de8e4-35ec-4ba9-bfef-2f0c71a2c2ea None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:01.051703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 509/997] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:01.057199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:01.057745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:01.057745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:01.075525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:01.076752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:01.167412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 489/998] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:01.191309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598de8e4-35ec-4ba9-bfef-2f0c71a2c2ea None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:01.311706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598de8e4-35ec-4ba9-bfef-2f0c71a2c2ea None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:01.363185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:01.364026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:01.364326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:01.364633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:01.365388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:01.366776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:01.379216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:01.380419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:01.381254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 510/999] 10.222.0.60 () {56 vars in 1105 bytes} [Tue May 10 17:32:01 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:01.392725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:01.514160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9123c2-666d-4330-b22b-7336f957e4b7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:01.576254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:01.577442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:01.577934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:01.578434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:01.580940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:01.581484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:01.584147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba261-da09-499a-b10e-7caa250adc13 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:01.599360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 490/1000] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:01.601145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:01.704759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb9cd-0fa3-434e-87b1-bd70aba8dad3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:01.737328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:01.738003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:01.738302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:01.738567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:01.739396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] RBAC: Adding query filter params (type=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:01.739716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:01.741106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89277a-0cb3-4b38-8655-f66875dcb083 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:01.755444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 511/1001] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:02.243351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a938-f894-4dd3-85d5-0de43155f39a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.243897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a938-f894-4dd3-85d5-0de43155f39a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.244241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3a938-f894-4dd3-85d5-0de43155f39a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.246463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 491/1002] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:02.255103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.255604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.256055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.281170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:02.283058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:02.392762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 512/1003] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:02.417145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3a938-f894-4dd3-85d5-0de43155f39a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:02.542909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3a938-f894-4dd3-85d5-0de43155f39a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:02.592889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:02.593718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.594006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.594291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.595811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:02.597204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-31143344-9c79-4d20-9398-d176d2315db6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:02.615473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:02.616527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 17:32:02.617348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.619720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 492/1004] 10.222.0.60 () {56 vars in 1126 bytes} [Tue May 10 17:32:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:02.623525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:02.696219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125f61-159b-412c-a668-189d7db1024b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.696484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125f61-159b-412c-a668-189d7db1024b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.696779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98125f61-159b-412c-a668-189d7db1024b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.698590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 493/1005] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:02.703826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.704709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.705078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.722108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:02.723320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:02.760061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91342aeb-a900-4684-9022-99c1f8c174d8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:02.799653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 494/1006] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:02.800883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:02.801562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.801853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.802130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.802880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:02.803183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:02.804595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:02.812402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 513/1007] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:32:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:02.816356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:02.820731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:02.928323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0426-3fc1-4ba2-97d5-b9496b324e99 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:02.953319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf59ab-7031-4a5a-bad7-6a26f1a8b3f1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:02.968584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:02.969401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.970247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.970534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.971209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:02.972619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:02.984734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:02.986702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:02.988010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 495/1008] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:32:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:02.992943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:02.993185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:02.993664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:02.993940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:02.994213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:02.994937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:02.995309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:02.996922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:03.004857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 514/1009] 10.222.0.60 () {56 vars in 1122 bytes} [Tue May 10 17:32:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:03.010539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:03.118240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae65f3-7665-493f-aa19-e402441331d4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:03.124449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117262dd-71e0-4165-825f-4aa48cf483a0 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:03.153931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:03.154600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:03.154888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:03.155167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:03.155951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:03.157385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:03.160305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:03.160988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:03.161277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:03.161554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:03.162280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:03.162589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:03.164128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:03.170434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 496/1010] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:32:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:03.174984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 515/1011] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:32:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:03.176623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:03.300411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebf9c7-1e39-4824-bacf-15dc6bddbfc6 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:03.348062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:03.348847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:03.349079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:03.349314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:03.350051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:03.350365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:03.351801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857506aa-45fa-4dff-a070-75a44d67f89d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:03.362691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 497/1012] 10.222.0.60 () {56 vars in 1112 bytes} [Tue May 10 17:32:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:03.364378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:03.470368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f836be-b396-419f-9137-fe9f89ea7159 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:03.506698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:03.507440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:03.507866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:03.508155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:03.508927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:03.510310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbec69c-c316-4e39-a8cf-e294185f6906 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:03.535403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 516/1013] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:32:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:32:04.117100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586ba6-582d-44c5-8ddb-bddff0fa6626 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:04.117574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586ba6-582d-44c5-8ddb-bddff0fa6626 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:04.117821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586ba6-582d-44c5-8ddb-bddff0fa6626 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:04.121383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 498/1014] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:04.127567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d251-6513-4418-92de-7f0cb883867f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:04.127858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d251-6513-4418-92de-7f0cb883867f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:04.128147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d251-6513-4418-92de-7f0cb883867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:04.148001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7838d251-6513-4418-92de-7f0cb883867f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:04.149207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7838d251-6513-4418-92de-7f0cb883867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:04.239787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 517/1015] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:04 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:04.255307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f586ba6-582d-44c5-8ddb-bddff0fa6626 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:04.367240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f586ba6-582d-44c5-8ddb-bddff0fa6626 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:04.403967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:04.404677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:04.404969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:04.405275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:04.406033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:04.408083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763362-c645-4003-a7ea-b52b3afe6a04 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:04.433863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 499/1016] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:32:04 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:32:05.550112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a72b-42f4-480f-bc39-f46200433de1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:05.550678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a72b-42f4-480f-bc39-f46200433de1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:05.550678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94a72b-42f4-480f-bc39-f46200433de1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:05.552115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 518/1017] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:05.557534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:05.557968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:05.558156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:05.576071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:05.577279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:05.654210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 500/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:05.679524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a72b-42f4-480f-bc39-f46200433de1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:05.788147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94a72b-42f4-480f-bc39-f46200433de1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:05.825885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:05.826615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:05.826902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:05.827183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:05.828469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:05.830150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8499789-f246-4aea-9630-e2e53ebc0260 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:05.832041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 519/1019] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:05.841068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:05.967056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce68b9-dcc4-4fb0-8ff1-3d1836d77b38 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:06.005388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:06.006076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.006366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.006647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.007388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:06.008852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c02d62-c04d-4469-a0ab-77c47fe09024 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:06.045156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 501/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:32:05 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:06.047158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b379a-7274-4b75-a33b-3fe7b6c1dd1d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.047499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b379a-7274-4b75-a33b-3fe7b6c1dd1d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.048646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b379a-7274-4b75-a33b-3fe7b6c1dd1d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.050426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 520/1021] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:06.057501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.057792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.058136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.081280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:06.082440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:06.191444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 502/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:06.216450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b379a-7274-4b75-a33b-3fe7b6c1dd1d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:06.368426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b379a-7274-4b75-a33b-3fe7b6c1dd1d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:06.430915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:06.432380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.432892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.433398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.453275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:06.470545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:06.472152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:06.473014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:06.474086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 521/1023] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:32:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:06.484747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:06.601221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bad0-5b47-4df0-a308-90d77fbfc34f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:06.640931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:06.642139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.642430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.642776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.643637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:06.643958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:06.645387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6935907-f862-4989-bff0-07716ed77d50 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:06.655265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 503/1024] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:32:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:06.661971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:06.764910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a878b-0dfe-4494-ae06-c330b3584c02 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:06.798700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:06.799532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.799826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.800107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.811304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:06.814471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:06.830889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc71b-7185-4a92-99b8-842c44d3bb6b None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.831222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc71b-7185-4a92-99b8-842c44d3bb6b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.831494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc71b-7185-4a92-99b8-842c44d3bb6b None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.834433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 504/1025] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:06.834608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:06.843416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:06.844359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:06.844359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:06.844359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:06.844359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:06.844359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 522/1026] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:06.844900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:06.844900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:06.844900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:06.848411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:06.864459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:06.865667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:06.952059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 505/1027] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:06.961816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b59bf-4095-4422-a2b2-2535be1efbb2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:06.979464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.006565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.007721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.008209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.008687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.010024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:07.010560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.013091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.036340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 523/1028] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:07.038024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.099647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f781-37ef-42b8-acfa-0b92796c2564 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.135488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.136289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.136574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.136849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] PATH_INFO: `/v3/services/image` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.137512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.138887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.147245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c99-7c5e-4765-afab-62eb1bd57b42 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:07.151833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:07.152807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:07.153672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:07.159547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 506/1029] 10.222.0.60 () {56 vars in 1105 bytes} [Tue May 10 17:32:06 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:07.161892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.183242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.184088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.184381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.184663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.193183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.194657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:32:07.211491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:07.212490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:07.218242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 524/1030] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:07.220161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.268149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2ab00-5bcb-4315-a452-848c22026888 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.304198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.304912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.305202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.305483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.306247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:07.306582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.308091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.313443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 507/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:07.319638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.327001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fe7d3-cccd-4c0e-90f8-c072968fcfc2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.363030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.363749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.364037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.364318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.365205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:07.365521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.366960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.395411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 525/1032] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:07.410644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.446097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc9dc-010c-452e-9fc9-0f29a4a1bc07 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.491284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.492090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.492475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.492859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.493830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] RBAC: Adding query filter params (type=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:07.494269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.496173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.502780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 508/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:07.509146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.540005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386e1b-8ad7-4f4d-8e9c-0d731c4b2259 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.578512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.579991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.580292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.580575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.629497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04053a51-8e01-47e6-a998-b36cad803630 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.659586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.661421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.665212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.665882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.666192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.666475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.667321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] RBAC: Adding query filter params (interface=public, service_id=608f34f902ad45cbb2cc24e09d62a895, region_id=RegionOne) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:07.667673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.669083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.679648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 509/1034] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/endpoints?service_id=608f34f902ad45cbb2cc24e09d62a895&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:07.680766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.772645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 526/1035] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:07.778229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:07.794277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31603b5-10f5-48dc-8ed3-263ebe3bd0d5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.831318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.834870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.834870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.834870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.834870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.834870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.842069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 510/1036] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:32:07.888619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cfb41-f2ce-43f2-aced-0cfe1ba5bab8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:07.936156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:07.937227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:07.937644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:07.938018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:07.953210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:07.955497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:07.980351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:07.981367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:07.988155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:07.988155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:07.988155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:07.988155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:07.988155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 527/1037] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:07.988877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.096611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb4465-55a0-4ab7-ac89-537af296aaa4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.133943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.134689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.135170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.135575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.136555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:08.136972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.138849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.162654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 511/1038] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:08.168732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.274027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982deb4-f0fe-4d2c-bedd-f453a51e04fd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.312426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.313384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.314454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.314454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.321755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.323217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-750db1dd-a2ed-4804-b326-3606459d3ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:32:08.338918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:08.340144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:08.341391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 528/1039] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:08.348557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.453506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b8ad-074c-4fbc-bb55-356c29ff22c4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.472332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a3-7718-44bb-ba36-b4709e1196f9 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.472715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a3-7718-44bb-ba36-b4709e1196f9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.473095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd3a3-7718-44bb-ba36-b4709e1196f9 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.474574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 529/1040] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:08.480230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.480565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.480852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.489442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.490119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.490408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.490686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.491514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:08.491835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.493259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.498377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:08.499628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:08.510141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 512/1041] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:08.511455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.584194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 530/1042] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:08.609885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.613695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b427-c32d-41b9-942e-2d20b5039ba8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.649913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.650568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.650861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.651144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.652386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] RBAC: Adding query filter params (role.id=6158cdc2c196407eb95a7f974f4d036f, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:08.652386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.653761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.660979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 513/1043] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:08 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=6158cdc2c196407eb95a7f974f4d036f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:08.729022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d7c5-a1fa-42b3-a8b8-ce90ff7d903d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.770542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.771451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.771697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.771981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.773292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.774755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38518f-865e-449f-9574-5633573a4b05 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.781402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 531/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:08.782992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:08.897817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe2c12-3ef0-4717-9998-910058ee38a9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:08.931963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:08.932647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:08.932938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:08.933248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:08.933971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:08.935428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b9f1b-9e5f-4427-816e-dc4b4804253a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:08.963865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 514/1045] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:32:08 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:10.191953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff653ef-ef3e-4805-bc42-8735c09d5e4d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.192511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff653ef-ef3e-4805-bc42-8735c09d5e4d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.192511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff653ef-ef3e-4805-bc42-8735c09d5e4d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.193920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 532/1046] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:10.199280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.199735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.199906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.218248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:10.220021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:10.288431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 515/1047] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:10.310801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff653ef-ef3e-4805-bc42-8735c09d5e4d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:10.412877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff653ef-ef3e-4805-bc42-8735c09d5e4d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:10.446523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:10.447233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.447549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.447828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] PATH_INFO: `/v3/services/image` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.448486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:10.449874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:10.462019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:10.463058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 17:32:10.464402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:10.467703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 533/1048] 10.222.0.60 () {56 vars in 1105 bytes} [Tue May 10 17:32:10 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:10.469390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:10.564381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782065e-7a2d-4d6f-b127-a8c2201099cb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:10.598237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:10.598905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.599189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.599500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.600203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] RBAC: Adding query filter params (name=image) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:10.600505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:10.601858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:10.612278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 516/1049] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:10.613589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:10.720728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235420e-d857-4a24-9d62-087e942a4c22 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:10.761313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:10.762002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.762290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.762572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.763305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] RBAC: Adding query filter params (type=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:10.763651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:10.765090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a4e73-8bff-4ded-9cb3-0b05668d718f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:10.776149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 534/1050] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:10.778041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:10.904354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ff255-defb-4e3b-8bc1-076cb6bdf792 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:10.917617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39afd-8375-453b-a67e-11b92b773739 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.917970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39afd-8375-453b-a67e-11b92b773739 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.918258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39afd-8375-453b-a67e-11b92b773739 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.919761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 535/1051] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:10.926135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.926433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.926717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.946329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:10.948491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:10.951013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:10.951013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:10.951251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:10.951543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:10.952307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:10.954582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:10.976600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 517/1052] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:32:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:11.035716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 536/1053] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:11.059527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.198805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fb255-89b9-4002-b10b-7a191fcf20bf None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.237481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.238903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.238903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.238903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.253031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9a68e3da-37fc-4b1b-bf8e-a54fad68aeaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:11.261338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:11.262320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:11.263280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 518/1054] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:11.269731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.310211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31683b2-7784-4f2f-b435-17c971229390 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.310434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31683b2-7784-4f2f-b435-17c971229390 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.310668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31683b2-7784-4f2f-b435-17c971229390 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.312237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 519/1055] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:11.318066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.318353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.318636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.337765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:11.339000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:11.383529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684070fb-c2fc-4879-b379-a65bcb9d24c6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.415951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 520/1056] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:11.424998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.425684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.425974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.426256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.427029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:11.427338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.428840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:11.439274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.444992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 537/1057] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:11.446369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.551115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad76f-48dc-413f-90f4-5e89334b8ae2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.558095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25760cea-f260-4d5a-bb2f-17283c8708de None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.589686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.590498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.590783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.591059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.595304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.596135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.596417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.596693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.604704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:11.608100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.609582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:11.612518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:11.613720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:11.615144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 521/1058] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:11.619822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:11.637569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:11.638623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:11.639676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:11.639676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:11.639676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:11.639676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:11.639676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 538/1059] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:11.645407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.741058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a851ff-aa07-4d03-a818-ff53ecd39632 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.761720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8cd4-75fe-4b3c-9cdd-0e892b616685 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.783842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.784533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.784825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.785105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.787477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:11.787477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.787660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:11.796813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 522/1060] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:11.798502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.799183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.799503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.799791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.800570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:11.800888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.802339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:11.808470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.815737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 539/1061] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:11.824410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:11.940574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ccb0-9c00-4cdf-9aa1-73754252f132 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.944105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee0f7-ff24-429d-b05b-2cf6145c2ffe None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:11.977832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.978333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:11.978719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.978999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.979165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:11.979262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] PATH_INFO: `/v3/users/82615759ca3b47f0b7ffe7f07a1db52e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.979459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:11.979711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:11.987904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.989365 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:11.997128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] RBAC: Authorizing `identity:get_user(user_id=82615759ca3b47f0b7ffe7f07a1db52e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:11.998595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.000388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 523/1062] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/users/82615759ca3b47f0b7ffe7f07a1db52e => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:32:12.005481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:12.006472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:12.012691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 540/1063] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:32:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:12.013285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.013733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.122671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f9fe7-42b1-40a4-8b32-a026ac170461 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.137378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf231f-c5c9-4cb3-a0db-244731f8c39a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.159519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.160201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.160486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.160763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.161617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:12.161928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.163411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.176712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.177395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.177689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.177969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.187939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 541/1064] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:12.189594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.256647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.258121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.289813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a9dd-8177-4304-9d1f-dad3fae65264 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.324983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.325793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.326078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.326354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.337149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.338611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:12.356649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:12.357621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:12.364077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:12.364077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:12.364077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:12.364077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:12.364330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 524/1065] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:12.364414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 542/1066] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:12.364498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.364576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.468170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0c1e-02f9-4969-9970-900c2d9cd15b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.475277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684c38-977f-4101-a54b-4f1fe9c3fdbd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.509143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.510085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.510368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.510645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.511870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.513304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.520705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 543/1067] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:12.520844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.520844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.520844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.520844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.521134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:12.521134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.521134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.521571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.538777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 525/1068] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:12.542123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.633238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fd1ce-199c-4008-ab07-aa259082a60d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.646838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f3094-0a23-4a4d-a9b4-18743cdb75b7 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.668857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.670044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.670044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.670044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.670983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae, user.id=82615759ca3b47f0b7ffe7f07a1db52e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:12.671301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.673074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.679410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 544/1069] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/role_assignments?user.id=82615759ca3b47f0b7ffe7f07a1db52e&scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:12.681310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.682124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.682408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.682682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.691904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.693383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:32:12.710194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:12.711257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:12.712958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 526/1070] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:12.717430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:12.834817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0dabd-5c4b-46d0-9f8f-56c9b46b7204 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:12.871763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:12.872453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:12.872744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:12.873026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:12.874503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:12.874820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:12.876850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72f6ea-1ce1-49b5-8e39-968b0eed095f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:12.890299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 545/1071] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:12.898254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:13.030171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ee9e-c669-45bb-bd68-cf6f40a7a084 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:13.083389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:13.084906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:13.085394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:13.085850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/6158cdc2c196407eb95a7f974f4d036f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:13.089630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=3a3e49e317144906907311bac205bef9, role_id=6158cdc2c196407eb95a7f974f4d036f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:13.091404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c932eae-ceb1-4175-b3a1-25ed8dba825b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:13.115410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 527/1072] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:32:12 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/3a3e49e317144906907311bac205bef9/roles/6158cdc2c196407eb95a7f974f4d036f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:32:13.320948 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15c2a-ab0a-4555-bc5f-5bf76ec8fcef None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:13.321491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15c2a-ab0a-4555-bc5f-5bf76ec8fcef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:13.321491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15c2a-ab0a-4555-bc5f-5bf76ec8fcef None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:13.325125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 546/1073] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:13.332822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:13.333302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:13.333413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:13.350420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:13.351575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:13.421515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 528/1074] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:13.444860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15c2a-ab0a-4555-bc5f-5bf76ec8fcef None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:13.551563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15c2a-ab0a-4555-bc5f-5bf76ec8fcef None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:13.589392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:13.590105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:13.590466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:13.590761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:13.660643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:13.662045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:13.763398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 547/1075] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 17:32:13.771410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:13.879886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a068c70-d5d4-4149-8cb3-f70b6b5d375c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:13.918881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:13.919732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:13.920020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:13.920298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:13.931431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:13.932911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-6e7152a6-52ba-474e-85f9-a9041d69b48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:13.952643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:13.954152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:13.955608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:13.955608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:13.955608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:13.955608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:13.955608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 529/1076] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:13.961116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:14.063814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54fb9-512a-49a5-861a-de63da671328 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:14.099125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:14.099839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:14.100128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:14.100406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:14.101137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:14.101447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:14.102824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdd10a-c37e-4858-aef8-1e1eb5574205 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:14.119400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 548/1077] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:15.014789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f30c-9bed-4d29-adef-52fd499a710f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.015324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f30c-9bed-4d29-adef-52fd499a710f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.015439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91f30c-9bed-4d29-adef-52fd499a710f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.017664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 530/1078] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:15.023350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.023923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.024045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.040629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:15.041813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:15.113082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 549/1079] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:15.136551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f30c-9bed-4d29-adef-52fd499a710f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.241950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91f30c-9bed-4d29-adef-52fd499a710f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.279080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.279915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.280211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.280490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.291257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f8ba1cf8-3fbe-43c3-b9c6-f38541a63dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:15.299793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:15.300889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:15.301750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 531/1080] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:15.307084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.406500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceffe2-fd3f-479d-a329-801c2942e7b5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.428795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680576-19ca-4c82-a109-694c6ed165b9 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.429086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680576-19ca-4c82-a109-694c6ed165b9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.429386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c680576-19ca-4c82-a109-694c6ed165b9 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.430764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 532/1081] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:15.435960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.436250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.436532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.442291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.442981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.443273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.443581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.444352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:15.444669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:15.446062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:15.454608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 550/1082] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:15.455241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:15.456476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:15.461053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.523855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 533/1083] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:15.548362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.559526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa846e2-9dfe-4a14-8657-dcdd36cd843b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.592634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.593507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.593786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.594059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] PATH_INFO: `/v3/users/82615759ca3b47f0b7ffe7f07a1db52e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.596263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] RBAC: Authorizing `identity:get_user(user_id=82615759ca3b47f0b7ffe7f07a1db52e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:15.597712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:15.599350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 551/1084] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/users/82615759ca3b47f0b7ffe7f07a1db52e => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:15.605025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.646381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5d03d-0d72-4de3-9aa6-24f6bc43b2de None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.680521 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.681342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.681627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.681904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.692743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:15.700995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:15.702287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:15.703302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 534/1085] 10.222.0.60 () {56 vars in 1120 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:15.709072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.709594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b2543-42d5-4e84-87cb-b8729651fa81 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.744022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.744895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.745179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.745467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.746673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:15.748159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:15.750015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 552/1086] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:15.756074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.809147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618081-01c4-4683-9adc-f4352a21ddfa None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.851340 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.852104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.852392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.852676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.853563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:15.853804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:15.855281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:15.868396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 535/1087] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:15.868616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cecf5-552b-4277-999d-99882e9f17da None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:15.871599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:15.902271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:15.903164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:15.903474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:15.903757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae/users/82615759ca3b47f0b7ffe7f07a1db52e/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:15.905787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c2f38ab2114283ab2a0286bd7439ae, user_id=82615759ca3b47f0b7ffe7f07a1db52e, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:15.907950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:15.921035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 553/1088] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:32:15 2022] PUT /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae/users/82615759ca3b47f0b7ffe7f07a1db52e/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:32:15.981030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367c203-1328-4e3c-983f-295faf198d08 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.018051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.018850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.019134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.019442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.031083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.033399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:16.051373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:16.052646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:16.053593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:16.053593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:16.053593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:16.053593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:16.053593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 536/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:16.059012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:16.162725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f236cd-db77-4a7e-87ac-f3d89ed990f0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.196686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d675-364b-49b1-8384-862750208523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.197384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d675-364b-49b1-8384-862750208523 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.197670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d675-364b-49b1-8384-862750208523 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.197951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d675-364b-49b1-8384-862750208523 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.198677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d675-364b-49b1-8384-862750208523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:16.198987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d675-364b-49b1-8384-862750208523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.200394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d675-364b-49b1-8384-862750208523 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:16.218286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 554/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:16.219737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:16.320352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306f7fa-47ef-429b-9a72-c23e2e3ac07a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.357472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.358273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.358559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.358836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.367222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.368699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:32:16.382418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:16.383760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:16.385631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 537/1091] 10.222.0.60 () {56 vars in 1093 bytes} [Tue May 10 17:32:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:16.391119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d675-364b-49b1-8384-862750208523 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:16.489468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d675-364b-49b1-8384-862750208523 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.522987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.523686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.523974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.524252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.525085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:16.525397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.526826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:16.543806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 555/1092] 10.222.0.60 () {56 vars in 1133 bytes} [Tue May 10 17:32:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:16.549682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:16.646845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed40ef0-b50b-404d-a82b-21800af50cfd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.679041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.679739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.680031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.680311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.744693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.746148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:16.841179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 538/1093] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:16.847312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:16.942581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dc99-f7f8-442e-9fd3-2357c2c1595e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:16.976896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:16.977693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:16.977983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:16.978263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:16.988923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:16.990391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:17.008634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:17.009773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:17.010692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:32:17.010692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:17.010692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:32:17.010692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:17.010692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 556/1094] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:17.015617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:17.116998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc111085-2cf7-4c07-9311-511bd5f10f98 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:17.150807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:17.151553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:17.151847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:17.152127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:17.152863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:17.153175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:17.154546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:17.167039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 539/1095] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:17.173830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:17.277436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cf527-a42d-41c1-ad0a-1b99221adfd7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:17.311446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:17.312249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:17.312537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:17.312820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:17.321189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:17.322651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:32:17.338323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:17.339515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:17.340818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 557/1096] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:17.345970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:17.463207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2d238-4eba-4d31-a17c-527e6beea822 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:17.501630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:17.502301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:17.502592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:17.502876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:17.503713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:17.504032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:17.505480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d19b0-1291-448e-b225-64e759ec050e None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:17.518926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 540/1097] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:17.525168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:17.639829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e3f0a-070c-4b7c-a3ab-a85575eb07bd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:17.675973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:17.676784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:17.677185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:17.677584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:17.678537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] RBAC: Adding query filter params (role.id=6158cdc2c196407eb95a7f974f4d036f, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=3a3e49e317144906907311bac205bef9) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:17.678966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:17.680563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5495b-70f2-4787-8b0e-dadb6389630c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:17.686834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 558/1098] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:17 2022] GET /identity/v3/role_assignments?user.id=3a3e49e317144906907311bac205bef9&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=6158cdc2c196407eb95a7f974f4d036f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:18.218946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e2390-728a-45bc-b563-69cf8096c067 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.220181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e2390-728a-45bc-b563-69cf8096c067 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.220181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e2390-728a-45bc-b563-69cf8096c067 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:18.221628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 541/1099] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:18.227709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.228234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.228234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:18.255733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:18.256967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:18.329087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 559/1100] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:18.352414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e2390-728a-45bc-b563-69cf8096c067 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:18.457412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e2390-728a-45bc-b563-69cf8096c067 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:18.492044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:18.492763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.493051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.493337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:18.504262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:18.511812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:18.512772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:18.513742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 542/1101] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:18.519675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:18.626137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2525c-8a82-4bc9-aa0b-e4e5250f773c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:18.666483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:18.667188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.667516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.667797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:18.668599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:18.668916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:18.670374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:18.680231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 560/1102] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:18.686575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:18.790181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba141-4b69-4822-bd1c-f05c5bed3371 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:18.824271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:18.825140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.825423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.825697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] PATH_INFO: `/v3/users/82615759ca3b47f0b7ffe7f07a1db52e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:18.826882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] RBAC: Authorizing `identity:get_user(user_id=82615759ca3b47f0b7ffe7f07a1db52e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:18.828350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:18.830645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 543/1103] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:18 2022] GET /identity/v3/users/82615759ca3b47f0b7ffe7f07a1db52e => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:18.836601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:18.931178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0cb12-a006-4a2c-b27a-8bf45c97b37d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:18.965633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:18.966288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:18.966570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:18.966846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:19.033429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:19.034888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:19.134077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 561/1104] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:19.140178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:19.236629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab09920-084d-4128-bfbd-729d8622b01a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:19.268953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:19.269815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:19.270099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:19.270370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:19.271611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:19.273030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed95de1-d0e1-4f1b-a810-dd9051dfc355 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:19.274734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 544/1105] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:19 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:19.282254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:19.378949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a4b17-dc96-4538-a3d1-ab798cf89ba1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:19.413744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:19.414327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:19.414769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:19.414885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:19.415751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae, user.id=82615759ca3b47f0b7ffe7f07a1db52e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:19.416082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:19.417533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f611d-3981-4ff9-bdc1-886ca121df8b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:19.424972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 562/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:19 2022] GET /identity/v3/role_assignments?user.id=82615759ca3b47f0b7ffe7f07a1db52e&scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:21.706334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d807d8-107a-4fa9-8dec-73ea30ea6f48 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:21.706885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d807d8-107a-4fa9-8dec-73ea30ea6f48 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:21.706885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d807d8-107a-4fa9-8dec-73ea30ea6f48 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:21.708294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 545/1107] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:21.713709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:21.714136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:21.714274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:21.731927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:21.733130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:21.798564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 563/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:21.823114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d807d8-107a-4fa9-8dec-73ea30ea6f48 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:21.921945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d807d8-107a-4fa9-8dec-73ea30ea6f48 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:21.954999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:21.955823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:21.956114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:21.956448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:21.957578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:21.959003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a3cc4-7775-47ca-9fad-34964c37bff3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:21.960646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 546/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:21.966505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:22.061109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d081-668f-44d3-90a0-32da7e7d7554 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:22.095306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:22.096002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:22.096289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:22.096566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:22.097280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:22.098722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca8da-add0-4cc2-af28-780dc93cbe0a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:22.117937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 564/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:32:21 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:32:24.398164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5d8e-eb3f-4806-acc2-e85cddea0b1f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:24.398700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5d8e-eb3f-4806-acc2-e85cddea0b1f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:24.398700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5d8e-eb3f-4806-acc2-e85cddea0b1f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:24.400307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 547/1111] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:24.405575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:24.405997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:24.406139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:24.423722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:24.424912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:24.489311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 565/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:24.513146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e5d8e-eb3f-4806-acc2-e85cddea0b1f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:24.618108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e5d8e-eb3f-4806-acc2-e85cddea0b1f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:24.653090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:24.653861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:24.654140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:24.654515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] PATH_INFO: `/v3/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:24.656002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] RBAC: Authorizing `identity:get_role(role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:24.658113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:24.659515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 548/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:24 2022] GET /identity/v3/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:24.665362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:24.760120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cab057-8130-460d-85b7-dc929904a38b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:24.793909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:24.794771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:24.795053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:24.795330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] PATH_INFO: `/v3/users/02bf9f75adcb449fb04f8b27f87b814e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:24.808976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=02bf9f75adcb449fb04f8b27f87b814e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:24.810425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:24.812181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 566/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:24 2022] GET /identity/v3/users/02bf9f75adcb449fb04f8b27f87b814e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:24.818317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:24.913698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d2698-2312-4300-9be6-a0fd476a557f None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:24.945795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:24.946435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:24.946746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:24.947024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:25.010582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:25.012059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:25.110331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 549/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:25.116299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:25.210718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dfe41-7820-4175-9d1d-63c5b2ac7ac3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:25.243294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:25.244171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:25.244459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:25.244746 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:25.245922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:25.247358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cccfd-ef12-4813-bd34-84c9e2ca5a61 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:25.249071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 567/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:25 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:25.255784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:25.358935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c48670-1a89-4972-99e0-21a6bccad8a3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:25.395193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:25.395887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:25.396178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:25.396456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:25.397295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae, user.id=02bf9f75adcb449fb04f8b27f87b814e) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:25.397612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:25.399059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb794e-d534-4fde-978c-ba6aaf732e65 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:25.404441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 550/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:25 2022] GET /identity/v3/role_assignments?user.id=02bf9f75adcb449fb04f8b27f87b814e&scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:27.731180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfa05-532f-4c91-a733-9f7388d577b6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:27.731805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfa05-532f-4c91-a733-9f7388d577b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:27.731805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfa05-532f-4c91-a733-9f7388d577b6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:27.733121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 568/1118] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:27.738917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:27.739331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:27.739511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:27.756554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:27.757721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:27.821184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 551/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:27.843589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bfa05-532f-4c91-a733-9f7388d577b6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:27.942093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bfa05-532f-4c91-a733-9f7388d577b6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:27.977174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:27.978031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:27.978319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:27.978598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] PATH_INFO: `/v3/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:27.980136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] RBAC: Authorizing `identity:get_role(role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:27.981564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:27.982908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 569/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:27 2022] GET /identity/v3/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:27.988984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:28.092296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a41a-320d-454d-8daf-84fadba0c861 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:28.129277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:28.130148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:28.130435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:28.130712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] PATH_INFO: `/v3/users/02bf9f75adcb449fb04f8b27f87b814e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:28.132181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] RBAC: Authorizing `identity:get_user(user_id=02bf9f75adcb449fb04f8b27f87b814e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:28.133621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:28.135262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 552/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:27 2022] GET /identity/v3/users/02bf9f75adcb449fb04f8b27f87b814e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:28.141575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:28.253070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207bea0-c512-4c0e-936e-6904000886e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:28.297763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:28.298623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:28.298908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:28.299188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:28.300481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:28.301944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5ad7-04ab-4085-abe5-4330986bf020 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:28.303720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 570/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:28 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:28.314735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:28.445889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ec06-5078-439c-9565-bf47d260f26d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:28.496762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:28.497664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:28.497947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:28.498224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae/users/02bf9f75adcb449fb04f8b27f87b814e/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:28.501184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c2f38ab2114283ab2a0286bd7439ae, user_id=02bf9f75adcb449fb04f8b27f87b814e, role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:28.502772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedcfc4-4587-4cc3-a2e5-817d75c08bb4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:28.519135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 553/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:32:28 2022] PUT /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae/users/02bf9f75adcb449fb04f8b27f87b814e/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:32:30.963794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fcc63-b379-4c38-8a6a-040f48d08ba4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:30.964344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fcc63-b379-4c38-8a6a-040f48d08ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:30.964344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fcc63-b379-4c38-8a6a-040f48d08ba4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:30.965781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 571/1124] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:30.972274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:30.972767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:30.972868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:30.989844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:30.991053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:31.058055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 554/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:31.084410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fcc63-b379-4c38-8a6a-040f48d08ba4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:31.183330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fcc63-b379-4c38-8a6a-040f48d08ba4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:31.219627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:31.220481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:31.220818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:31.221196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] PATH_INFO: `/v3/roles/7f6db42d8d494a99abfe78bc5e08c236` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:31.222782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] RBAC: Authorizing `identity:get_role(role_id=7f6db42d8d494a99abfe78bc5e08c236)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:31.224222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:31.225633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 572/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:31 2022] GET /identity/v3/roles/7f6db42d8d494a99abfe78bc5e08c236 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:31.231721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:31.358183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc511-0612-445a-9f11-c05fa52e41a0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:31.396256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:31.397131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:31.397418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:31.397699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] PATH_INFO: `/v3/users/02bf9f75adcb449fb04f8b27f87b814e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:31.399087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=02bf9f75adcb449fb04f8b27f87b814e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:31.400561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:31.402225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 555/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:31 2022] GET /identity/v3/users/02bf9f75adcb449fb04f8b27f87b814e => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:31.408833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:31.513685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2dcb0b-caa9-4900-8ea0-39a96d1b37e8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:31.546539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:31.547845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:31.548136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:31.548414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:31.615930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:31.617404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:31.717191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 573/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:31.724041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:31.822206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3b423-0ad3-49cf-b52d-477a34f7a5c3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:31.856315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:31.857185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:31.857471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:31.857747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] PATH_INFO: `/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:31.858949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] RBAC: Authorizing `identity:get_project(project_id=d3c2f38ab2114283ab2a0286bd7439ae)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:31.861049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eedde-8474-45de-af16-bef3836ed72a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:31.862756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 556/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:31 2022] GET /identity/v3/projects/d3c2f38ab2114283ab2a0286bd7439ae => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:31.869806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:31.975150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c2c3-c74b-446a-abc2-c0ff0a7da990 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:32.007806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:32.008451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:32.008733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:32.009012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:32.009835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] RBAC: Adding query filter params (role.id=7f6db42d8d494a99abfe78bc5e08c236, scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae, user.id=02bf9f75adcb449fb04f8b27f87b814e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:32.010166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:32.011594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd42b0-7554-4337-9571-59c857829b13 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:32.017484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 574/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:31 2022] GET /identity/v3/role_assignments?user.id=02bf9f75adcb449fb04f8b27f87b814e&scope.project.id=d3c2f38ab2114283ab2a0286bd7439ae&role.id=7f6db42d8d494a99abfe78bc5e08c236 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:34.318002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452c46-d36b-42d5-a854-a2fba9383b07 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:34.318586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452c46-d36b-42d5-a854-a2fba9383b07 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:34.318586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452c46-d36b-42d5-a854-a2fba9383b07 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:34.319949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 557/1131] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:34.325855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:34.326386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:34.326386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:34.343688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:34.345403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:34.415083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 575/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:34.441458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452c46-d36b-42d5-a854-a2fba9383b07 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:34.547012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46452c46-d36b-42d5-a854-a2fba9383b07 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:34.580511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:34.581224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:34.581513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:34.581792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:34.582994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:34.584454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8087a6-3183-4168-81a8-087e10ad2755 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:34.586086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 558/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:34.592090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:34.691992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1157211-bfad-4350-97d9-a0370c290f6d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:34.727001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:34.727696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:34.727988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:34.728271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:34.729008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:34.730470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43121e2b-2238-4ad9-ab3f-821357bc7cfb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:34.759292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 576/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:32:34 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:37.110483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786b5c-541e-4bbf-b54f-9b90080d858a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:37.111052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786b5c-541e-4bbf-b54f-9b90080d858a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:37.111052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786b5c-541e-4bbf-b54f-9b90080d858a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:37.112745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 559/1135] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:37.118695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:37.119195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:37.119400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:37.137762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:37.139025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:37.233337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 577/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:37.261428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786b5c-541e-4bbf-b54f-9b90080d858a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:37.369302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786b5c-541e-4bbf-b54f-9b90080d858a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:37.405379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:37.406263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:37.406939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:37.406939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:37.408606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:37.410653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ee17-f01a-4386-b9fa-f79a349f8472 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:37.412492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 560/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:37.418561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:37.522133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05ffc-aa99-493e-b1ee-2eb751335d04 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:37.558156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:37.558906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:37.559244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:37.559616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:37.560398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:37.561906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a383c-3b37-4995-b8e2-c21eb9bcad69 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:37.584254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 578/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:32:37 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:39.947274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d9ac-554b-429a-b296-2f5a53d140e0 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:39.947920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d9ac-554b-429a-b296-2f5a53d140e0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:39.947920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5d9ac-554b-429a-b296-2f5a53d140e0 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:39.949256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 561/1139] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:39.954924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:39.955440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:39.955586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:39.973156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:39.974404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:40.042548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 579/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:40.066803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d9ac-554b-429a-b296-2f5a53d140e0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:40.168950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5d9ac-554b-429a-b296-2f5a53d140e0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:40.205480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:40.206300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:40.206591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:40.206873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:40.217684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:40.226479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:40.228411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:40.230372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 562/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:32:40.236117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:40.339286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2d31-8640-4a6f-9f18-e3f20330027d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:40.377511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:40.378204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:40.378499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:40.378779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:40.379587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:40.379900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:40.381363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:40.391065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 580/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:40.397394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:40.510117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d200972-e161-4ac8-b66e-73ceb33a7596 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:40.543056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:40.543965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:40.544254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:40.544531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] PATH_INFO: `/v3/users/486de517bad74c87a622b073996ee10b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:40.558502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] RBAC: Authorizing `identity:get_user(user_id=486de517bad74c87a622b073996ee10b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:40.560004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:40.562202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 563/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:40 2022] GET /identity/v3/users/486de517bad74c87a622b073996ee10b => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:40.569018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:40.674761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231c2ee-c275-4a24-aa9f-34359611888b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:40.708911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:40.709567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:40.709855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:40.710157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:40.779933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:40.782228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:40.884755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 581/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:40.895044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:41.000880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f653c71-4d17-4e7f-af13-1bb7aa49824d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:41.036029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:41.036816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:41.037103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:41.037377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] PATH_INFO: `/v3/projects/fb072c31bd724928bc4f0e42159f545a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:41.038580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] RBAC: Authorizing `identity:get_project(project_id=fb072c31bd724928bc4f0e42159f545a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:41.040049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d4b4-63a3-4b25-88a3-02dcbbd2babf None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:41.041776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 564/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:40 2022] GET /identity/v3/projects/fb072c31bd724928bc4f0e42159f545a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:41.048141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:41.162107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827cdc-5715-4213-b14e-404a13860394 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:41.202870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:41.203602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:41.203893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:41.204172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:41.205049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=fb072c31bd724928bc4f0e42159f545a, user.id=486de517bad74c87a622b073996ee10b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:41.205366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:41.206873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330f02e-0270-448d-8c83-0a89709ec210 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:41.213498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 582/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:41 2022] GET /identity/v3/role_assignments?user.id=486de517bad74c87a622b073996ee10b&scope.project.id=fb072c31bd724928bc4f0e42159f545a&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:43.560033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1fde-0c82-43de-983d-8ee32ac01654 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:43.560876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1fde-0c82-43de-983d-8ee32ac01654 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:43.561037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c1fde-0c82-43de-983d-8ee32ac01654 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:43.563038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 565/1147] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:32:43.570035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:43.570747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:43.570747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:43.589459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:43.590743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:43.659398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 583/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:43.685497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c1fde-0c82-43de-983d-8ee32ac01654 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:43.789063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c1fde-0c82-43de-983d-8ee32ac01654 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:43.823642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:43.824367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:43.824657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:43.824941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:43.836584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:43.844952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:43.846240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:43.848001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 566/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:43.852539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:43.955676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29859e-2b4f-4402-b25a-e653b62f1a73 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:43.991347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:43.992046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:43.992334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:43.992612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:43.993365 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:43.993672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:43.995057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:44.004134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 584/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:44.010280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:44.115623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5723f-7e23-4d81-98c6-5c5e13c2fbe2 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:44.153084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:44.153978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:44.154272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:44.154554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] PATH_INFO: `/v3/users/486de517bad74c87a622b073996ee10b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:44.156412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=486de517bad74c87a622b073996ee10b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:44.157863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:44.159582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 567/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:44 2022] GET /identity/v3/users/486de517bad74c87a622b073996ee10b => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:44.165800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:44.298572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e6c8-6a80-42ae-9746-f3bee5fc4112 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:44.334192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdda78-9008-4034-b841-9297721a414d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:44.335078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdda78-9008-4034-b841-9297721a414d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:44.335400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdda78-9008-4034-b841-9297721a414d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:44.335677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdda78-9008-4034-b841-9297721a414d None admin] PATH_INFO: `/v3/projects/fb072c31bd724928bc4f0e42159f545a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:44.336931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdda78-9008-4034-b841-9297721a414d None admin] RBAC: Authorizing `identity:get_project(project_id=fb072c31bd724928bc4f0e42159f545a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:44.338402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdda78-9008-4034-b841-9297721a414d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:44.340186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 585/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:44 2022] GET /identity/v3/projects/fb072c31bd724928bc4f0e42159f545a => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:44.347301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:44.448441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35c455-2514-4778-8570-5905a2197fc3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:44.482053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:44.482954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:44.483236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:44.483534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] PATH_INFO: `/v3/projects/fb072c31bd724928bc4f0e42159f545a/users/486de517bad74c87a622b073996ee10b/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:44.486534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=fb072c31bd724928bc4f0e42159f545a, user_id=486de517bad74c87a622b073996ee10b, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:44.488123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1eab-2346-4936-970d-4febfc29d4ce None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:44.504160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 568/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:32:44 2022] PUT /identity/v3/projects/fb072c31bd724928bc4f0e42159f545a/users/486de517bad74c87a622b073996ee10b/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:32:46.791471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a9fe-29cd-46b6-ac99-3bfde802dcf6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:46.792054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a9fe-29cd-46b6-ac99-3bfde802dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:46.792054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96a9fe-29cd-46b6-ac99-3bfde802dcf6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:46.793408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 586/1154] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:46.799121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:46.799614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:46.799711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:46.816708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:46.817899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:46.883152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 569/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:32:46.907679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96a9fe-29cd-46b6-ac99-3bfde802dcf6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.024559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96a9fe-29cd-46b6-ac99-3bfde802dcf6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.057119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.057825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.058115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.058392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.069097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:32:47.076613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:47.078593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:32:47.079503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 587/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:47.084653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.179074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c137da-8417-458e-ad67-a6c8358d96a0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.212870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.213541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.213830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.214108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.214868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:47.215181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:47.216578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:47.224547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 570/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:32:47.230453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.330928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59797343-7ec4-4bf2-aa75-45389ed7cbbd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.366320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.367219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.367545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.367828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] PATH_INFO: `/v3/users/486de517bad74c87a622b073996ee10b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.369141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] RBAC: Authorizing `identity:get_user(user_id=486de517bad74c87a622b073996ee10b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:47.370622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:47.372412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 588/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:32:47 2022] GET /identity/v3/users/486de517bad74c87a622b073996ee10b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:47.378472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.485753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440754-3e7f-4de7-acb8-e2545cd3b9c9 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.523210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.523903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.524196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.524477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.596550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:47.597939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:47.697021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 571/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:47.703857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.799698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a718b-f48d-445a-9d5b-f86ebbd33469 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.834210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.835073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.835357 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.835663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] PATH_INFO: `/v3/projects/fb072c31bd724928bc4f0e42159f545a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.836866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] RBAC: Authorizing `identity:get_project(project_id=fb072c31bd724928bc4f0e42159f545a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:47.838310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c769eda-67fa-4ef6-864d-f02ad7bc6a91 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:47.840057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 589/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:32:47 2022] GET /identity/v3/projects/fb072c31bd724928bc4f0e42159f545a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:47.847314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:47.942841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bfc44-99b3-4a71-a3f9-8a701e15d5a5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:47.975819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:47.976476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:47.976764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:47.977042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:47.977876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=fb072c31bd724928bc4f0e42159f545a, user.id=486de517bad74c87a622b073996ee10b) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:47.978195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:47.979643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba7c4c-cd49-472e-8571-fdc94c654ae7 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:47.985667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 572/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:32:47 2022] GET /identity/v3/role_assignments?user.id=486de517bad74c87a622b073996ee10b&scope.project.id=fb072c31bd724928bc4f0e42159f545a&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:50.286457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b2d3-8ab4-4f30-9402-20311e217630 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:50.287020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b2d3-8ab4-4f30-9402-20311e217630 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:50.287020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b2d3-8ab4-4f30-9402-20311e217630 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:50.288401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 590/1162] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:50.293699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:50.294155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:50.294257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:50.311204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:50.313517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:50.381995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 573/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:50.406424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b2d3-8ab4-4f30-9402-20311e217630 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:50.508053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b2d3-8ab4-4f30-9402-20311e217630 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:50.541735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:50.542321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:50.542614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:50.542898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:50.610596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:50.612100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:50.709676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 591/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:32:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:32:50.716069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:50.813652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124fb9-ce13-41f2-a985-527e82c82479 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:50.847655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:50.848464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:50.848775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:50.849050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:50.855601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:50.857030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-dd4a2150-df35-4751-a543-b163609b6b6f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:32:50.871346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:32:50.872619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:32:50.873493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 574/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:32:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:32:50.878637 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:50.980601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cc6d4-6f11-48f9-81d8-a1104a015a64 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:51.015973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:51.016650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:51.016939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:51.017221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:51.017955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:32:51.018272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:51.019673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b92ce-ba0e-4a9f-8b62-a9c00477ef5e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:51.026851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 592/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Tue May 10 17:32:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:53.368779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d2a-df50-4631-98af-c7b2f0e3002f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:53.369323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d2a-df50-4631-98af-c7b2f0e3002f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:53.369323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d2a-df50-4631-98af-c7b2f0e3002f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:53.370685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 575/1167] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:53.376728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded806a6-0403-4d79-8c73-c58855d574cd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:53.377210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded806a6-0403-4d79-8c73-c58855d574cd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:53.377315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded806a6-0403-4d79-8c73-c58855d574cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:53.394566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ded806a6-0403-4d79-8c73-c58855d574cd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:53.395808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ded806a6-0403-4d79-8c73-c58855d574cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:53.460583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 593/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:53.482918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d2a-df50-4631-98af-c7b2f0e3002f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:53.585470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d2a-df50-4631-98af-c7b2f0e3002f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:53.618484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:53.619204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:53.619467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:53.619754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:53.620523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:53.621914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b03605-30e2-461c-acf5-7f2bb5a56796 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:53.637348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 576/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Tue May 10 17:32:53 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:32:55.949412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8cfd-7ada-4b11-8819-e5dbd8190a41 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:55.949942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8cfd-7ada-4b11-8819-e5dbd8190a41 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:55.950053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8cfd-7ada-4b11-8819-e5dbd8190a41 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:55.951438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 594/1170] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:55.957534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:55.957978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:55.958102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:55.975121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:55.976388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:56.040938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 577/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:56.064373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8cfd-7ada-4b11-8819-e5dbd8190a41 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:56.164210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8cfd-7ada-4b11-8819-e5dbd8190a41 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:56.196796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:56.197653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:56.197933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:56.198209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] PATH_INFO: `/v3/domains/2bb8fbfd697c43c3b0ba33040db17b6f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:56.209068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2bb8fbfd697c43c3b0ba33040db17b6f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:56.210511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cbe0d-2284-474e-8588-67ac6e822c77 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:56.212228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 595/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Tue May 10 17:32:56 2022] GET /identity/v3/domains/2bb8fbfd697c43c3b0ba33040db17b6f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:56.218155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:56.314748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597eebe-ae76-48d2-8c44-612e8814ff6e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:56.358710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:56.359545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:56.359833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:56.360110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:56.360826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:56.362256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82e95c-b848-4c1d-af88-3bcc1e4b2892 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:56.396359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 578/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:32:56 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:32:58.707323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced829-33a1-4534-9021-eefbb0f07d66 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:58.707954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced829-33a1-4534-9021-eefbb0f07d66 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:58.707954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced829-33a1-4534-9021-eefbb0f07d66 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:58.709297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 596/1174] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:32:58.715496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:58.715985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:58.716089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:58.732924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:32:58.734723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:32:58.800801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 579/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:32:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:32:58.825943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced829-33a1-4534-9021-eefbb0f07d66 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:58.928050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced829-33a1-4534-9021-eefbb0f07d66 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:58.961336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:58.962110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:58.962397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:58.962670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] PATH_INFO: `/v3/domains/2bb8fbfd697c43c3b0ba33040db17b6f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:58.963884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2bb8fbfd697c43c3b0ba33040db17b6f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:58.965323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b49af5-b319-4bac-8041-e0dac10e1a73 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:58.966951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 597/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Tue May 10 17:32:58 2022] GET /identity/v3/domains/2bb8fbfd697c43c3b0ba33040db17b6f => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:32:58.972892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:32:59.070530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ebae2-2a6a-4269-83c8-9c059ae7c989 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:32:59.106786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:32:59.107590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:32:59.107883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:32:59.108165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:32:59.109587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:32:59.111041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0febb-9b57-432a-8f09-ddd94151a415 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:32:59.131971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 580/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:32:58 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:33:01.440185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8db10-de6e-4366-9811-4304df3bf96c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:01.441008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8db10-de6e-4366-9811-4304df3bf96c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:01.441008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8db10-de6e-4366-9811-4304df3bf96c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:01.442360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 598/1178] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:33:01.447655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:01.448098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:01.448225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:01.464386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:33:01.465599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:33:01.529301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 581/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:33:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:33:01.553609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8db10-de6e-4366-9811-4304df3bf96c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:01.664973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8db10-de6e-4366-9811-4304df3bf96c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:01.700753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:01.701469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:01.701756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:01.702134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:01.713426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:33:01.721856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:33:01.723145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:33:01.724212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 599/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:33:01.729348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:01.832424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532ec40-c268-493a-b952-6d659cd13d1b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:01.869394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:01.870073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:01.870408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:01.870672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:01.871767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:33:01.871767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:01.873114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:01.881458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 582/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:01.887163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:01.986866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a376-c786-43c4-a889-7907c1615c2a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:02.020194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:02.021073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:02.021357 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:02.021631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] PATH_INFO: `/v3/users/e2540a8509f94e29ae257e7047a95418` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:02.035328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e2540a8509f94e29ae257e7047a95418)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:02.036817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:02.038527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 600/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:33:01 2022] GET /identity/v3/users/e2540a8509f94e29ae257e7047a95418 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:02.044419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:02.140827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab37f2-dcd9-4809-a8a9-f4f7ad5358d8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:02.173556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:02.174210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:02.174496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:02.174774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:02.241923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:02.243288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:02.342907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 583/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:33:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:33:02.348769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:02.448191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b5feb-d4e3-4b12-8b17-87a9df1948b0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:02.482776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:02.484805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:02.485100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:02.485381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] PATH_INFO: `/v3/projects/9b3a5df821284b0884af07574546a669` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:02.486603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3a5df821284b0884af07574546a669)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:02.488081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92aba0-70bc-4ca8-a61d-cb11a065fc68 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:02.489802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 601/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:33:02 2022] GET /identity/v3/projects/9b3a5df821284b0884af07574546a669 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:02.495940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:02.594810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ed78d-88f2-4fd6-8fd4-3cf11d032633 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:02.627601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:02.628261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:02.628541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:02.628814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:02.629642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=9b3a5df821284b0884af07574546a669, user.id=e2540a8509f94e29ae257e7047a95418) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:33:02.629952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:02.631377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce73d8a-999b-440e-9672-134b182cfb91 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:02.636830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 584/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:33:02 2022] GET /identity/v3/role_assignments?user.id=e2540a8509f94e29ae257e7047a95418&scope.project.id=9b3a5df821284b0884af07574546a669&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:04.884184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968079-8dcf-4f83-8466-a22fc54529f6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:04.885079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968079-8dcf-4f83-8466-a22fc54529f6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:04.885454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968079-8dcf-4f83-8466-a22fc54529f6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:04.886832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 602/1186] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:33:04.893078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:04.893548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:04.893646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:04.911346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:33:04.912572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:33:04.979486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 585/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:33:05.002903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968079-8dcf-4f83-8466-a22fc54529f6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:05.104797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968079-8dcf-4f83-8466-a22fc54529f6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:05.138177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:05.138969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:05.139254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:05.140183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:05.150232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:33:05.158026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:33:05.159133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:33:05.160085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 603/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:33:05.165376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:05.264231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff755a9-98f4-44ef-956a-5624df4a0ae4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:05.298045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:05.298722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:05.299009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:05.299290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:05.300083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:33:05.300397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:05.301770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:05.310285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 586/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:33:05.317687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:05.424348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b731ca-9038-4851-8556-86676b7c8f34 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:05.460925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:05.461808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:05.462096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:05.462376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] PATH_INFO: `/v3/users/e2540a8509f94e29ae257e7047a95418` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:05.463657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2540a8509f94e29ae257e7047a95418)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:05.465131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:05.466852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 604/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:33:05 2022] GET /identity/v3/users/e2540a8509f94e29ae257e7047a95418 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:05.472966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:05.575969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a1483-8d51-45d7-afc9-41249c74fcd4 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:05.608694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:05.609562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:05.609848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:05.610123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] PATH_INFO: `/v3/projects/9b3a5df821284b0884af07574546a669` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:05.611333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] RBAC: Authorizing `identity:get_project(project_id=9b3a5df821284b0884af07574546a669)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:05.612804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617108-9b18-4282-8a9f-f85f82ee880d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:05.614526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 587/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:33:05 2022] GET /identity/v3/projects/9b3a5df821284b0884af07574546a669 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:05.620458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:05.721709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f38a34-e9c9-4a07-86b3-0ae1c5ed4ea3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:05.758880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:05.759795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:05.760086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:05.760367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] PATH_INFO: `/v3/projects/9b3a5df821284b0884af07574546a669/users/e2540a8509f94e29ae257e7047a95418/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:05.762345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b3a5df821284b0884af07574546a669, user_id=e2540a8509f94e29ae257e7047a95418, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:05.763825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f497f2-80f1-4e36-869e-0704ec4cea10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:05.776810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 605/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:33:05 2022] PUT /identity/v3/projects/9b3a5df821284b0884af07574546a669/users/e2540a8509f94e29ae257e7047a95418/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:33:08.023082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081774-070d-4e3f-9695-660337faed17 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.023657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081774-070d-4e3f-9695-660337faed17 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.023657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4081774-070d-4e3f-9695-660337faed17 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.025048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 588/1193] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:33:08.030540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.030960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.031101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.047819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:33:08.049022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:33:08.113470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 606/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:33:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 17:33:08.136538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4081774-070d-4e3f-9695-660337faed17 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:08.233382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4081774-070d-4e3f-9695-660337faed17 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:08.265850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:08.266639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.266928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.267206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.277327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:33:08.284929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:33:08.286048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:33:08.286947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 589/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:33:08.292311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:08.386825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4abc-119f-4290-9e4c-14fc8af6c838 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:08.420913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:08.421579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.421865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.422138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.422921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:33:08.423190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:08.424576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:08.432556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 607/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:08.438891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:08.536471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632565d-c40f-4a8f-a8b4-9596bb604923 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:08.569831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:08.570702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.570987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.571315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] PATH_INFO: `/v3/users/e2540a8509f94e29ae257e7047a95418` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.572499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] RBAC: Authorizing `identity:get_user(user_id=e2540a8509f94e29ae257e7047a95418)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:08.573914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:08.575574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 590/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Tue May 10 17:33:08 2022] GET /identity/v3/users/e2540a8509f94e29ae257e7047a95418 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:08.581543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:08.676505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b549281-8db6-426e-9419-578baf8e3ad6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:08.708895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:08.709542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:08.709827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:08.710104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:08.774002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:08.775486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:08.872512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 608/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:33:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:33:08.879173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:08.978062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba892f-a0f9-4cb5-8f57-db9ab6af7927 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:09.010406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:09.011267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:09.011578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:09.011859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] PATH_INFO: `/v3/projects/9b3a5df821284b0884af07574546a669` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:09.013040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9b3a5df821284b0884af07574546a669)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:09.015028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dfb73-1d94-44df-b498-fe6e8a07a7b2 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:09.016943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 591/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Tue May 10 17:33:08 2022] GET /identity/v3/projects/9b3a5df821284b0884af07574546a669 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:33:09.022998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:33:09.118272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e37d31-766f-4f3f-9c11-4655bc35dc97 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:33:09.153175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:33:09.153842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:33:09.154130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:33:09.154412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:33:09.155291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=9b3a5df821284b0884af07574546a669, user.id=e2540a8509f94e29ae257e7047a95418) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:33:09.155646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:33:09.157088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8061-77d5-4008-93d1-c813df96c989 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:33:09.163269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 609/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:33:09 2022] GET /identity/v3/role_assignments?user.id=e2540a8509f94e29ae257e7047a95418&scope.project.id=9b3a5df821284b0884af07574546a669&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:13.132483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a70c-0050-467c-870a-eba076169afd None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:13.133293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a70c-0050-467c-870a-eba076169afd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:13.133293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a70c-0050-467c-870a-eba076169afd None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:13.134415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 592/1201] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:34:13.144618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:13.145435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:13.145435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:13.173087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:13.174403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:13.265644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 610/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:13.286690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471a70c-0050-467c-870a-eba076169afd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:13.470335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471a70c-0050-467c-870a-eba076169afd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:13.521712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:13.521712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:13.521712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:13.521712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:13.545997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:13.547740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:13.576768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:13.578184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:13.579488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:13.579488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:13.579488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:13.579488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:13.587406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 593/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:13.587587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:13.732730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fb65-d44f-48e2-956a-ebf47d9583dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:13.775654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:13.776744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:13.777305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:13.777855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:13.779702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:13.780384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:13.782667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeac0de-9d42-4dc8-82b2-9297096c9403 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:13.811203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 611/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:34:13.821751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:13.971771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b40f8f-e344-4265-a061-a2751460f627 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:14.021659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:14.023052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:14.023723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:14.024163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:14.025251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:14.027880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee198bf-5dd4-4fd9-9bd0-e4b18837ba10 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:14.058608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 594/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Tue May 10 17:34:13 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:34:16.747562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d4c3-545c-49c6-ad65-f46086b495a5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:16.748415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d4c3-545c-49c6-ad65-f46086b495a5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:16.748415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9d4c3-545c-49c6-ad65-f46086b495a5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:16.749507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 612/1206] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:34:16.757399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:16.758254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:16.758254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:16.789903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:16.791234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:16.891104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 595/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:16.917528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d4c3-545c-49c6-ad65-f46086b495a5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:17.111762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9d4c3-545c-49c6-ad65-f46086b495a5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:17.176042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:17.177501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:17.178025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:17.178501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:17.205737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:17.214292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:17.216239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:17.217682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 613/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:34:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:17.227804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:17.392809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba94833-94e9-4845-8dc2-7bd22d28eba3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:17.442123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:17.442886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:17.443252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:17.443496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:17.444311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:17.444711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:17.446366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:17.467410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 596/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:34:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:17.468847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:17.624439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e943a-588e-4787-8d8e-c25a29a09e0f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:17.674859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:17.675911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:17.676296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:17.676617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:17.693198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:17.694696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:17.715943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:17.717576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:17.719468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:17.719468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:17.719468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:17.719468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:17.722490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 614/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:17.724366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:17.879837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0f30c-7079-473c-a0fa-052639adc86b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:17.929770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:17.930524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:17.930866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:17.931166 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:17.932094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:17.932466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:17.934401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:17.959455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 597/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:34:17.968456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:18.083810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e15da1-6599-4195-90e0-5c916f3732a7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:18.126925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:18.128185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:18.128594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:18.128861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:18.137275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:18.138751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:18.157621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:18.158879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:18.159902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 615/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:18.167212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:18.311669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d79da-d59f-4020-b808-9d4f6fd05775 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:18.371955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:18.372828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:18.373213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:18.373601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:18.374589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:18.374989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:18.376656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:18.408673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 598/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:18.409974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:18.553819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c31eb-1765-43f2-97f4-76b12eb1b0ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:18.604840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:18.605516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:18.606243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:18.606632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:18.696974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:18.698686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:18.835390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 616/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:34:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:34:18.837643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:18.975730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dc718-42f1-412b-a6fc-36c28cadfbad None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:19.033742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:19.034710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:19.035013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:19.035239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:19.055740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:19.058935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:19.099951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:19.101439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:19.102665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:19.102665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:19.102665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:19.102665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:19.108414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 599/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:19.109991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:19.288194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54962ad-0f37-4f9c-8f90-0cbcc8162234 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:19.340141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:19.340742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:19.341029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:19.341316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:19.342041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:19.342346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:19.343945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:19.356647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 617/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:19.363617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:19.523485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e78c59-c12b-430a-a6f4-26c9bfe69a27 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:19.581382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:19.582096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:19.582392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:19.582695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:19.590280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:19.591843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:19.606995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:19.608066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:19.608985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:19.613394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 600/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:19.614381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:19.745214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb13b-0adc-4e70-81bf-2e85e9e5a326 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:19.790210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:19.790210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:19.790210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:19.790210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:19.790788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:19.790788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:19.790788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c27117-0c80-4ef7-bc8a-4718480ba0b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:19.806007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 618/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:19.813218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:19.959123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86e9a-53c0-466c-b7f0-aecb88c44296 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:19.996983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:19.997797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:19.998081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:19.998327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:19.999212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=228acc1362ed42cc82e3f5ddc0467ed0) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:19.999564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:20.001121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48472b7-eea8-4e79-b7ab-a46c7f9a1f27 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:20.019410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 601/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:34:19 2022] GET /identity/v3/role_assignments?user.id=228acc1362ed42cc82e3f5ddc0467ed0&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:22.273562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9678-d30c-4792-a863-718762e2a1e0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:22.274383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9678-d30c-4792-a863-718762e2a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:22.274383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9678-d30c-4792-a863-718762e2a1e0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:22.275692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 619/1220] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:22.281772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:22.282299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:22.282299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:22.306460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:22.307330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:22.394707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 602/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:22.421669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9678-d30c-4792-a863-718762e2a1e0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:22.536428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9678-d30c-4792-a863-718762e2a1e0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:22.576179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:22.576989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:22.577268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:22.577609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:22.592719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:22.603887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:22.605051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:22.606616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 620/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:34:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:22.612634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:22.721838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6f2cc-0063-4828-8eee-0fd93d8a0ad0 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:22.757374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:22.758124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:22.758335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:22.758604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:22.759379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] RBAC: Adding query filter params (name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:22.759698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:22.762743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:22.770212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 603/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:34:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:22.777012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:22.884677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa48f8-0fb0-4cf5-b10b-c58d9a23f1a6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:22.920265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:22.921065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:22.921348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:22.921622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:22.932187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:22.934285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:22.952665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:22.953900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:22.954892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:22.954892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:22.954892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:22.954892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:22.954892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 621/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:22.960009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:23.068031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d86d0-0141-492e-80a5-46a69a6a84db None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:23.104118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:23.104710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:23.104998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:23.105276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:23.106943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:23.107400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:23.108786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:23.121447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 604/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:23.127531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:23.241393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b135-b4d1-4312-9694-bae35c7af532 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:23.279384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:23.280213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:23.280496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:23.280770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:23.288565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:23.290015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:23.304404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:23.305619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:23.306626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 622/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:23.312384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:23.448389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cf07-bf99-48e5-b744-f28e48ce44c3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:23.494138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:23.494774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:23.495061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:23.495339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:23.496895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:23.497213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:23.498660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:23.519781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 605/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:23.525639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:23.650982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfe3f9-2839-4468-a8f4-481b6134bcc2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:23.693108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:23.694230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:23.694515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:23.694792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:23.709073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:23.710582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:23.729730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:23.731619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:23.732729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:23.732729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:23.732729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:23.732729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:23.732729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 623/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:23.737545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:23.841010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6569b72-bd14-41a6-9605-393def8a68bd None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:23.884246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:23.885121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:23.885415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:23.885734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:23.886902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:23.887960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:23.889761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:23.905613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 606/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:23.911495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:24.024673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794cb39-9bba-4d0d-9cd6-80761978f5b6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:24.063335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:24.064183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:24.064470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:24.064780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:24.075606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:24.077467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:24.096682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:24.097919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:24.099015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 624/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:24.104441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:24.229346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8b336-dbcc-4933-89e1-62aa222c1b50 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:24.276926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:24.278766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:24.279129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:24.279447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:24.280338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:24.280722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:24.282335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf45b4d-1849-4498-a97c-ada92af1bc35 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:24.296485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 607/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:34:24.303099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:24.434397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bb04c-c221-47b6-bbac-8bbb67f80528 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:24.480526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:24.481442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:24.481720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:24.481995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/228acc1362ed42cc82e3f5ddc0467ed0/roles/1e921e8832a940268ed1949ecc770595` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:24.498655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=228acc1362ed42cc82e3f5ddc0467ed0, role_id=1e921e8832a940268ed1949ecc770595)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:24.499743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2d689-714c-4fe0-8cec-f9441cbb72aa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:24.516436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 625/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:34:24 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/228acc1362ed42cc82e3f5ddc0467ed0/roles/1e921e8832a940268ed1949ecc770595 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:34:26.989132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273490-4f60-4e8b-9f66-6c2db1e2fe85 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:26.989807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273490-4f60-4e8b-9f66-6c2db1e2fe85 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:26.989807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c273490-4f60-4e8b-9f66-6c2db1e2fe85 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:26.991079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 608/1233] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:26.997198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:26.997712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:26.997804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.014171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:27.015409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:27.087732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 626/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:27.111539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273490-4f60-4e8b-9f66-6c2db1e2fe85 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:27.227245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c273490-4f60-4e8b-9f66-6c2db1e2fe85 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:27.265201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:27.266395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:27.266808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:27.267130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.279792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:27.288235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:27.289242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 17:34:27.290074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:27.295639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 609/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Tue May 10 17:34:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:27.296886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:27.407703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c29b-bd6f-4f46-838d-7cc89b7c4054 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:27.445961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:27.446640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:27.446907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:27.447186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.448206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:27.448352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:27.449896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:27.460459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 627/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Tue May 10 17:34:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:27.466478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:27.574416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24a80-a447-459c-8015-3f7e8a3d7938 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:27.614437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:27.615203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:27.615526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:27.615802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.628119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:27.629576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:27.652047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:27.653078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:27.654301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:27.654301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:27.654301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:27.654301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:27.654530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 610/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:27.660403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:27.774953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48b0a4-331b-4d29-96d4-f1f7473b4eb1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:27.815512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:27.816937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:27.817259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:27.817575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.818416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:27.818804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:27.820341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:27.833263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 628/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:27.839638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:27.955891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1e23f-cd20-46ba-ab10-5e7f2b0e2d42 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:27.988935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:27.989723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:27.990312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:27.990312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:27.998811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:28.000291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:28.015434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:28.016632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:28.017591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 611/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:28.022633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:28.129678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7770-98b5-435e-b2cb-b49e2c0c4266 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:28.170057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:28.170839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:28.171156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:28.171552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:28.172455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:28.172775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:28.174392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:28.194767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 629/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:34:28.200756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:28.310553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64834f-5fc9-4b2b-be16-57334fab04fb None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:28.349591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:28.350362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:28.350685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:28.350968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:28.432192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:28.433894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:28.552105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 612/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:34:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:34:28.559566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:28.682448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf537-740b-4c98-b043-d7cb2457e9ca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:28.719487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:28.720343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:28.720579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:28.720862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:28.731686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:28.733158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:28.752681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:28.753933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:28.755257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:28.755257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:28.755257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:28.755257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:28.755257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 630/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:28.760147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:28.868528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164c60a-0b6e-492c-825a-af188c8f46f5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:28.912409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:28.913489 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:28.913871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:28.914369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:28.915705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:28.916170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:28.919274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:28.938945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 613/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:28.948280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:29.071827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa3237-fa1a-4ef8-83dd-50223a2aeb77 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:29.111106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:29.111936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:29.112217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:29.112503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:29.120014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:29.121907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:29.138411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:29.139707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:29.140733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 631/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:29.145657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:29.255906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ef69-58bf-4315-8164-2669a9094fc3 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:29.295488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:29.296213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:29.296496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:29.296776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:29.297606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:29.298024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:29.299444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66050-11dd-47db-bdb7-69a16e9e69c4 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:29.313805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 614/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:29.321609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:29.445654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f96-c663-4a66-bcef-35eb66f3a92c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:29.492651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:29.493534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:29.493960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:29.494392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:29.495428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] RBAC: Adding query filter params (role.id=1e921e8832a940268ed1949ecc770595, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=228acc1362ed42cc82e3f5ddc0467ed0) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:29.496582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:29.498060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f652ce8-2c89-4c62-8798-29cdbc9e3fb9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:29.504444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 632/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:34:29 2022] GET /identity/v3/role_assignments?user.id=228acc1362ed42cc82e3f5ddc0467ed0&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=1e921e8832a940268ed1949ecc770595 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:34:32.126083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6cfc8-444f-49ad-8021-d1f470c64093 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.126632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6cfc8-444f-49ad-8021-d1f470c64093 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.126632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6cfc8-444f-49ad-8021-d1f470c64093 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.128033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 615/1247] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:32.134689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.135243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.135243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.155219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:32.156602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:32.234049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 633/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:32.259501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6cfc8-444f-49ad-8021-d1f470c64093 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:32.366934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6cfc8-444f-49ad-8021-d1f470c64093 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:32.405424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:32.406208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.406500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.406841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.418589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:32.427857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:32.429822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:32.430869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 616/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:32.435982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:32.562058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7e654-46d4-4623-ba29-805a7a99a020 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:32.605561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:32.606256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.606542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.606822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.607613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:32.607925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:32.609323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:32.619001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 634/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:32.626177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:32.740855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e2a5e-936c-4204-9b08-8d86d3e31494 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:32.778168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:32.779089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.779358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.779765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.791576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:32.793703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:32.813351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:32.814534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:32.815606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:32.815606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:32.815606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:32.815606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:32.815606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 617/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:32.821178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:32.947353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf09232-043b-4b14-a2ef-8ef9470c1d5c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:32.985916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:32.986609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:32.986901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:32.987179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:32.987980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:32.988330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:32.989696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:33.005056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 635/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:33.010796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:33.133732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d6877-948d-479c-bfa9-850b6fe77e86 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:33.174094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:33.174927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:33.175239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:33.175522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:33.184595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:33.186326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:33.203108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:33.204417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:33.210492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 618/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:33.211321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:33.327494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a19ff-29e4-4b62-aa25-457e90078253 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:33.362444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:33.363167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:33.363532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:33.363848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:33.364769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:33.365111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:33.366584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:33.387237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 636/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:33.395328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:33.524571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f1c9-f0b0-4ac3-ab85-edb53508b48d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:33.565254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:33.566189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:33.566479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:33.566820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:33.642062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:33.643547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:33.759076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 619/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:34:33.765715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:33.873092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8abf1-b489-4a31-b912-47b8139adbc5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:33.911299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:33.912156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:33.912473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:33.912780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:33.924636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:33.926101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:33.947821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:33.949949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:33.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:33.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:33.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:33.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:33.951547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 637/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:33.956358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:34.070318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca25a79-4d8f-41ec-b4b0-750242bd9e14 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:34.112229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:34.112979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:34.113348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:34.113665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:34.114562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:34.114943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:34.116636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:34.130052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 620/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:34.136286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:34.264518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba14c54-ed65-4f50-8782-28f3927ce090 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:34.301670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:34.301896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:34.302301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:34.303800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:34.310929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:34.312743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:34.331440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:34.332559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:34.333441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 638/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 17:34:34.339725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:34.453630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36100718-2960-46dc-a71c-dd03d8d6bce5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:34.499786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:34.500600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:34.501001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:34.501290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:34.502105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:34.502421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:34.503882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637a14-17dd-44a7-acc1-5808abae9ba1 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:34.516898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 621/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:34.522864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:34.632378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f2fb-9ada-45a1-b739-d44fa42b47cb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:34.669916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:34.670537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:34.670945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:34.671113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:34.671994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=228acc1362ed42cc82e3f5ddc0467ed0) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:34.672272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:34.673703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778f34-33c1-4462-a961-d823dca7969c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:34.679540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 639/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:34:34 2022] GET /identity/v3/role_assignments?user.id=228acc1362ed42cc82e3f5ddc0467ed0&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:36.941395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a84ac-bee7-481a-9f5e-bfff6493332a None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:36.941961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a84ac-bee7-481a-9f5e-bfff6493332a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:36.941961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a84ac-bee7-481a-9f5e-bfff6493332a None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:36.943299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 622/1261] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:36.948454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:36.949417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:36.949638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:36.966696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:36.967925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:37.031976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 640/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:37.054544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a84ac-bee7-481a-9f5e-bfff6493332a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.154717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a84ac-bee7-481a-9f5e-bfff6493332a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:37.187904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:37.188696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:37.188983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:37.189260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:37.201169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:37.208814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:37.209934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:37.210833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 623/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:37.216665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.319307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e2d32-a88f-4885-af56-91404bd053fe None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:37.353557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:37.354205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:37.354492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:37.354773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:37.355653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:37.356034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:37.357414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:37.365530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 641/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:37.371947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.482540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dec396-77bd-4b46-89da-3ed77e3fbd3e None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:37.519980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:37.520764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:37.521054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:37.521330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:37.532674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:37.534137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:37.551968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:37.553075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:37.553993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:37.553993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:37.553993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:37.553993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:37.553993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 624/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:37.559901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.655885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5d122-e923-4273-a77e-fc5af9e256be None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:37.687563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:37.688215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:37.688498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:37.688774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:37.689495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:37.689802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:37.691461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:37.703410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 642/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:37.709068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.822807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa954e4f-25d6-4c80-98c1-24180cb4b774 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:37.858450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:37.859258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:37.859579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:37.859966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:37.867610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:37.869048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:37.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:37.885108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:37.886412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 625/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:37.891831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:37.988731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551bbc1-3523-4674-b01a-f8ef3d3b5639 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.021710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.022377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.022658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.022930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.023802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:38.024106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.025547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.043703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 643/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:38.049061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:38.143964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2f554-d733-4f98-8440-3ac5f7db398a None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.175653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.176445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.176735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.177016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.187405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.188847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:38.206353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:38.207491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:38.208456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:38.208456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:38.208456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:38.208456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:38.208456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 626/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:38.213601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:38.310062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd4cfb-740e-46b3-a6eb-b55edf2a2f54 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.343823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.344492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.344778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.345059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.345801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:38.346109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.347528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.359859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 644/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:38.365497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:38.468850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee923ab-12f0-44d6-95d0-66ca98cb2be5 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.501635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.502504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.502828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.503169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.509900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.511932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:38.525591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:38.526607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:38.527673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 627/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:38.532684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:38.630856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f1a5-7a70-4d54-9c19-70110ce4e5ff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.662788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.663474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.663765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.664044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.664837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:38.665151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.666587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1014b3-7acc-4e39-95ed-003f5a07c3bd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.681803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 645/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:38.688820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:38.788653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de107d-ea5e-460f-b178-c3b1d59d0b0d None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:38.822885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:38.824936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:38.825246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:38.825529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] PATH_INFO: `/v3/projects/d020f9d4f9d143d287364c7b28282287/users/228acc1362ed42cc82e3f5ddc0467ed0/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:38.827555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] RBAC: Authorizing `identity:create_grant(project_id=d020f9d4f9d143d287364c7b28282287, user_id=228acc1362ed42cc82e3f5ddc0467ed0, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:38.828991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79352c96-2e78-4253-a44f-f784c28b595f None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:38.842124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 628/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Tue May 10 17:34:38 2022] PUT /identity/v3/projects/d020f9d4f9d143d287364c7b28282287/users/228acc1362ed42cc82e3f5ddc0467ed0/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:34:41.157351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308993e-a2ec-4215-a04f-20f58ae2624a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.157872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308993e-a2ec-4215-a04f-20f58ae2624a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.157872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308993e-a2ec-4215-a04f-20f58ae2624a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.159170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 646/1274] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:41.165249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.165758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.165857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.183407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:41.184655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:41.258698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 629/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:41.282082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308993e-a2ec-4215-a04f-20f58ae2624a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:41.383678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308993e-a2ec-4215-a04f-20f58ae2624a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:41.416835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:41.418213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.418519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.418802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.428762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 17:34:41.437355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:41.439026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:41.440499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 647/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Tue May 10 17:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:41.444858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:41.557535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61421cf5-9ca0-4d94-9fd9-4d8af8f213f5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:41.591899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:41.592562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.592847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.593122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.593866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:41.594171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:41.595554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:41.604299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 630/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Tue May 10 17:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:41.609999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:41.707120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b1143-30b8-4554-9e87-c3ac17693505 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:41.746806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:41.748129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.748627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.749133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.768244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:41.770976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:41.801969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:41.802958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:41.803901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:41.803901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:41.803901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:41.803901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:41.804382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 648/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:41.810410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:41.919922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170f49-c574-4796-b06e-35053f06d46b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:41.953376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:41.954050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:41.954339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:41.954619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:41.955346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:41.955686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:41.957051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:41.968712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 631/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:41.974422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:42.083524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cba04-8c05-4649-b6ef-7b2f4a1c793e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:42.117007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:42.117806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:42.118092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:42.118376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:42.126548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:42.128065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 17:34:42.142116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:42.143284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:42.144542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 649/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:42.149502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:42.251355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38798a-b6f9-4a87-a627-dfe4c0703c0b None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:42.287384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:42.288083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:42.288373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:42.288653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:42.289522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:42.289841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:42.291296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:42.311678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 632/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Tue May 10 17:34:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:42.321156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:42.458335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb61cf4-dfe2-44af-9c7b-16af641ef87d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:42.492099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:42.492754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:42.493040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:42.493316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:42.559740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:42.561127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:42.659774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 650/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Tue May 10 17:34:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 17:34:42.666171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:42.806503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532471e-23d3-4687-91ca-ba9ad57c7576 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:42.856601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:42.857810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:42.858204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:42.858590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:42.873733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:42.875960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 17:34:42.903126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:42.904385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:42.905375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 17:34:42.905375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 17:34:42.905375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 17:34:42.905375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:42.905375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 633/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:42.910752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:43.008466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527381-c5a8-43c5-8129-ea6d4388760c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:43.044212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:43.044955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:43.045295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:43.045622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:43.046415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:43.046771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:43.048249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:43.060182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 651/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Tue May 10 17:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:43.066137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:43.162447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00350af-2699-42d6-b06d-1a23bd4995d8 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:43.195882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:43.196680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:43.196970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:43.197250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:43.204049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:43.205503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 17:34:43.219887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application with Lock( May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:43.221069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: ERROR keystone.server.flask.application May 10 17:34:43.222103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 634/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Tue May 10 17:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:43.226892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:43.329154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e77a5-ebfc-41ad-b4f4-d479840e8957 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:43.365643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:43.366315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:43.366602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:43.366877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:43.367714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:43.368029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:43.369487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a8f88-99bc-4071-ad03-1297291aab9f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:43.382396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 652/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Tue May 10 17:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:43.389308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:43.489481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ad637-744e-4e94-87e2-d093a5a94662 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:43.529277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:43.529947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:43.530240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:43.530525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:43.531397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] RBAC: Adding query filter params (role.id=0d49494e76f84242bc3076803ab15e82, scope.project.id=d020f9d4f9d143d287364c7b28282287, user.id=228acc1362ed42cc82e3f5ddc0467ed0) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:43.531772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:43.533640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0667e4-a7e4-46a0-9780-b0aba3a278de None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:43.539705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 635/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Tue May 10 17:34:43 2022] GET /identity/v3/role_assignments?user.id=228acc1362ed42cc82e3f5ddc0467ed0&scope.project.id=d020f9d4f9d143d287364c7b28282287&role.id=0d49494e76f84242bc3076803ab15e82 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:45.836851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01f7a-d508-44d1-8636-e69b82d1620b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:45.837294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01f7a-d508-44d1-8636-e69b82d1620b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:45.837395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01f7a-d508-44d1-8636-e69b82d1620b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:45.838771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 653/1288] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:45.844169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:45.844643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:45.844738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:45.862357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:45.864242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:45.930193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 636/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:45.952940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01f7a-d508-44d1-8636-e69b82d1620b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:46.050789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01f7a-d508-44d1-8636-e69b82d1620b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:46.084778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:46.085575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:46.085875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:46.086248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:46.086861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:46.088226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:46.100358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:46.101590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:46.102858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 654/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:34:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:46.108354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:46.203471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e505-4107-4f1b-a583-c8fe1ce6f121 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:46.236171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:46.236862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:46.237153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:46.237433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:46.238148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:46.238455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:46.239865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b638122-3d57-4d82-a866-f489e6889662 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:46.244497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 637/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Tue May 10 17:34:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:46.250381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:46.346577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6b2dc-4793-4b46-8438-bff81b3820e0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:46.379312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:46.380003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:46.380293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:46.380569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:46.381277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:46.381587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:46.382968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9c85b-98bf-4d1e-87ce-c0e157352da5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:46.388065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 655/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Tue May 10 17:34:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:48.758609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d6ba-85a8-445c-a8e5-6f16e7d3d17d None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:48.759230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d6ba-85a8-445c-a8e5-6f16e7d3d17d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:48.759230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d6ba-85a8-445c-a8e5-6f16e7d3d17d None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:48.760629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 638/1293] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:48.766562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d414-3de0-47ce-a8d2-c4512dcfc3cf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:48.766993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d414-3de0-47ce-a8d2-c4512dcfc3cf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:48.767124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464d414-3de0-47ce-a8d2-c4512dcfc3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:48.784011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6464d414-3de0-47ce-a8d2-c4512dcfc3cf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:48.785194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6464d414-3de0-47ce-a8d2-c4512dcfc3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:48.857598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 656/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:48.879650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d6ba-85a8-445c-a8e5-6f16e7d3d17d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:48.976809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d6ba-85a8-445c-a8e5-6f16e7d3d17d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:49.009759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:49.010342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:49.010628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:49.011580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:49.012486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:49.013844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5896f-8f37-4e10-8db5-9b33a793cc3a None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:49.027424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 639/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Tue May 10 17:34:48 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:34:51.283971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea09245-1876-411b-a4e7-11267bec8a8a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:51.284528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea09245-1876-411b-a4e7-11267bec8a8a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:51.284528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea09245-1876-411b-a4e7-11267bec8a8a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:51.285922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 657/1296] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:51.291782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:51.292330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:51.292330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:51.310318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:51.311581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:51.383293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 640/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:51.406434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea09245-1876-411b-a4e7-11267bec8a8a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:51.522294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea09245-1876-411b-a4e7-11267bec8a8a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:51.554704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:51.555564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:51.555821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:51.555952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:51.556611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:51.558644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:51.570523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:51.571787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:51.572825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:51.575530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 658/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:34:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:51.578448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:51.672503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a887e0-fe00-4247-a4a2-3c3eda26e433 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:51.705371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:51.706042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:51.706335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:51.706618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:51.707338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:51.707681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:51.709057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:51.714304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 641/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Tue May 10 17:34:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:51.720333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:51.820624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88752462-fc74-4a6b-a627-b60d22d44d92 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:51.853071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:51.853732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:51.854018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:51.854294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:51.855766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] RBAC: Adding query filter params (interface=public, service_id=65860152de594e72ac3d0bb61eac62db, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:51.856081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:51.857449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4e227-3fe8-4520-8983-e67d3c06ff9a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:51.862920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 659/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Tue May 10 17:34:51 2022] GET /identity/v3/endpoints?service_id=65860152de594e72ac3d0bb61eac62db&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:51.868579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:51.965990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555db4-b2b3-4080-97e8-ace9d1750005 None admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:51.999236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:51.999928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:52.000219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:52.000504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:52.001201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:52.002673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabec6c-46ad-41d6-95c5-fa006ebfba6b None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:52.009552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 642/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Tue May 10 17:34:51 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:34:54.228698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed4c-c9b2-490c-9ee5-888752e032a3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:54.229289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed4c-c9b2-490c-9ee5-888752e032a3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:54.229289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ed4c-c9b2-490c-9ee5-888752e032a3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:54.231449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 660/1302] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:34:54.237666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:54.238205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:54.238205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:54.255309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:34:54.256527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:34:54.321743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 643/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:34:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 17:34:54.345319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ed4c-c9b2-490c-9ee5-888752e032a3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:54.443484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ed4c-c9b2-490c-9ee5-888752e032a3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:54.476542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:54.477371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:54.477663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:54.477946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:54.478611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:54.481239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 17:34:54.492887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 17:34:54.494110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: ERROR keystone.server.flask.application May 10 17:34:54.495337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 661/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Tue May 10 17:34:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 17:34:54.500235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:54.594466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf991519-19ee-4ae3-ba0c-dc70130d0cce None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:54.626844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:54.627535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:54.627827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:54.628108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:54.628811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:34:54.629121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:54.630477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc59245-9e5a-46ae-b5f8-27ca93799ea9 None admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:54.635430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 644/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Tue May 10 17:34:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:34:54.641917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:34:54.739259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fe928-dc35-435d-9de6-eca2cc1804e1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:34:54.771704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:34:54.772361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:34:54.772648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:34:54.772926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:34:54.773666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:34:54.775030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57641546-f29c-4c2d-a3a8-cfe1f2e5f441 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:34:54.793526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 662/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Tue May 10 17:34:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:36:00.575880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62349df-d49c-4d02-a664-4d38b22e6ae3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:00.576813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62349df-d49c-4d02-a664-4d38b22e6ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:00.577242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62349df-d49c-4d02-a664-4d38b22e6ae3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:00.579533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 645/1307] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:00.584849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35de75-e3c9-4697-b1ab-094537eed908 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:00.585919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35de75-e3c9-4697-b1ab-094537eed908 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:00.586348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35de75-e3c9-4697-b1ab-094537eed908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:00.672068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3a35de75-e3c9-4697-b1ab-094537eed908 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:00.673569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3a35de75-e3c9-4697-b1ab-094537eed908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:00.808058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 663/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:00.866978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:00.869018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:00.869813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:00.872681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 646/1309] 10.222.0.60 () {54 vars in 964 bytes} [Tue May 10 17:36:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:00.880317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99a0b-ba76-4cba-a2bc-6e32e6f2f3df None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:00.881604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99a0b-ba76-4cba-a2bc-6e32e6f2f3df None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:00.882436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb99a0b-ba76-4cba-a2bc-6e32e6f2f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:01.094853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0cb99a0b-ba76-4cba-a2bc-6e32e6f2f3df None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:01.097667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0cb99a0b-ba76-4cba-a2bc-6e32e6f2f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:01.336151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 664/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Tue May 10 17:36:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:01.347285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:01.350262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:01.561677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc65884-7c89-4320-8b03-06e926f9eaef None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:01.650454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:01.651938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:01.652821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:01.653426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:01.655384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:01.788694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:01.790297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd267e0d-6a0d-446a-9ab9-fa7a680456c7 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:01.814346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 647/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:04.528800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:04.529370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:04.529370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:04.530788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 665/1312] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:04.536450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c2bb-a8cd-4943-a2f3-7905ed4c727e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:04.536907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c2bb-a8cd-4943-a2f3-7905ed4c727e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:04.537009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c2bb-a8cd-4943-a2f3-7905ed4c727e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:04.623684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5b74c2bb-a8cd-4943-a2f3-7905ed4c727e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:04.624828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5b74c2bb-a8cd-4943-a2f3-7905ed4c727e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:04.720862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 648/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:04.759152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:04.760905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:04.871510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea59b80-f4d7-483c-b81c-05206f4aa496 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:04.948790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:04.949451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:04.949743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:04.950027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:04.951717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:05.060779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:05.062250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86570a4c-00a8-4e57-ae4c-5d147c81ffda service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:05.081113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 666/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:07.702998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:07.703645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:07.703645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:07.704967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 649/1315] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:07.710446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d60a-3717-4527-81c1-824f19c9e862 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:07.710907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d60a-3717-4527-81c1-824f19c9e862 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:07.711024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940d60a-3717-4527-81c1-824f19c9e862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:07.774679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6940d60a-3717-4527-81c1-824f19c9e862 None None] MFA Rules not processed for user `ff925927bea446fda1816c4d1ed6afe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:07.775968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6940d60a-3717-4527-81c1-824f19c9e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:07.873149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 667/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:07.913130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:07.915726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:08.020008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85b72-e28d-4a30-862a-2e37e9d911ee None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:08.091347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:08.092028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:08.092315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:08.092593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:08.094238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:08.200065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:08.201505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b53fb-a8ff-4d1d-be90-ca07b8fd9714 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:08.219629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 650/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:11.059085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8157c2-072d-41de-aedf-d4a3ac536916 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:11.059737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8157c2-072d-41de-aedf-d4a3ac536916 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:11.059737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8157c2-072d-41de-aedf-d4a3ac536916 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:11.061044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 668/1318] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:11.067094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b498-c5f1-403d-ae55-ba5559a88e84 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:11.067585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b498-c5f1-403d-ae55-ba5559a88e84 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:11.067689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b498-c5f1-403d-ae55-ba5559a88e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:11.130926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-15d3b498-c5f1-403d-ae55-ba5559a88e84 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:11.132093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-15d3b498-c5f1-403d-ae55-ba5559a88e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:11.228543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 651/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:36:11.283101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:11.283484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:11.283805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:11.285624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 669/1320] 10.222.0.60 () {54 vars in 964 bytes} [Tue May 10 17:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:11.292822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643068-9371-48d4-9cdf-356bc58bb108 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:11.293114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643068-9371-48d4-9cdf-356bc58bb108 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:11.293398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643068-9371-48d4-9cdf-356bc58bb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:11.368879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-48643068-9371-48d4-9cdf-356bc58bb108 None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:11.370116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-48643068-9371-48d4-9cdf-356bc58bb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:11.445308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 652/1321] 10.222.0.60 () {58 vars in 1061 bytes} [Tue May 10 17:36:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:11.454725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:11.456299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:11.558085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751364b-bf3a-4fd2-970d-a221abdbb0b6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:11.630290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:11.630935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:11.631218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:11.631532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:11.633725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:11.737765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:11.739122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972521b-0e1f-41ad-adb7-69e966f85855 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:11.757542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 670/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:15.136587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:15.137097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:15.137097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:15.138357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 653/1323] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:15.144082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da22-1794-412b-bf0c-e39ac1e6f03e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:15.144480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da22-1794-412b-bf0c-e39ac1e6f03e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:15.144671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092da22-1794-412b-bf0c-e39ac1e6f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:15.208441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3092da22-1794-412b-bf0c-e39ac1e6f03e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:15.209645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3092da22-1794-412b-bf0c-e39ac1e6f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:15.308876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 671/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:15.345949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:15.347626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:15.456430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf20c29-e52f-451b-bd09-83ff568c0763 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:15.531480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:15.532158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:15.532449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:15.532777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:15.534447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:15.643783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:15.645279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebf5b5-1db4-4b0e-b4e1-5be03f4ad20d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:15.665276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 654/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:17.986104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:17.986661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:17.986661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:17.988213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 672/1326] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:17.994328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd0be-0bdd-4f21-a811-c478b33d6b12 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:17.994857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd0be-0bdd-4f21-a811-c478b33d6b12 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:17.994964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd0be-0bdd-4f21-a811-c478b33d6b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:18.065881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b9cfd0be-0bdd-4f21-a811-c478b33d6b12 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:18.067397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b9cfd0be-0bdd-4f21-a811-c478b33d6b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:18.171326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 655/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:18.207994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:18.209510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:18.318335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a551d1a-783e-411c-a787-7b80ccea0c22 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:18.403655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:18.404311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:18.404594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:18.404873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:18.406548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:18.519889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:18.521318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ae6ea-2966-4778-8bd6-7ce887f60b2b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:18.539852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 673/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:20.862281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:20.862834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:20.862834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:20.864306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 656/1329] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:20.870109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fbce4-cca3-4dbf-9160-7147ef3ab712 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:20.870625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fbce4-cca3-4dbf-9160-7147ef3ab712 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:20.870727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fbce4-cca3-4dbf-9160-7147ef3ab712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:20.939805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-db0fbce4-cca3-4dbf-9160-7147ef3ab712 None None] MFA Rules not processed for user `ff925927bea446fda1816c4d1ed6afe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:20.941116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-db0fbce4-cca3-4dbf-9160-7147ef3ab712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:21.042350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 674/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:21.080173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:21.081845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:21.191773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eebc60-baa5-44c1-9771-61fe0e4269f3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:21.264190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:21.264845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:21.265131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:21.265410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:21.267068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:21.379334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:21.380833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73a49b-736d-4fcd-b87d-dd091595dd48 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:21.403770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 657/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:24.036115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:24.036663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:24.036663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:24.038029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 675/1332] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:24.044524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b07b-1ad8-4855-910b-4f213a6c180d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:24.044962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b07b-1ad8-4855-910b-4f213a6c180d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:24.045099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b07b-1ad8-4855-910b-4f213a6c180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:24.119613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7641b07b-1ad8-4855-910b-4f213a6c180d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:24.120845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7641b07b-1ad8-4855-910b-4f213a6c180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:24.224806 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 658/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:24.260362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:24.261926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:24.366808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440203d8-7449-45fb-9741-0f372ee24e25 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:24.441071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:24.442033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:24.442321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:24.442607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:24.444341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:24.558063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:24.559574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcaf5d-6cec-44f0-b350-fef07f8f86cc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:24.579886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 676/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:36:26.917604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:26.918172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:26.918172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:26.919574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 659/1335] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:26.924897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1b8e-5662-4311-9b4e-714ca0ca325e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:26.925327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1b8e-5662-4311-9b4e-714ca0ca325e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:26.925500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1b8e-5662-4311-9b4e-714ca0ca325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:26.991144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f3df1b8e-5662-4311-9b4e-714ca0ca325e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:26.993142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f3df1b8e-5662-4311-9b4e-714ca0ca325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:27.092983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 677/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:27.133089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:27.134648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:27.239763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91002bf-2989-4f04-9e4d-f2ef72af1a98 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:27.315461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:27.316126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:27.316414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:27.316957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:27.318641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:27.426279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:27.427762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95d5c5-e946-42de-88ff-e4bf87ac1e44 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:27.447515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 660/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:30.071076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:30.071723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:30.071849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:30.073335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 678/1338] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:30.079379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39494-004d-4c9d-83d9-08528e7710a1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:30.079850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39494-004d-4c9d-83d9-08528e7710a1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:30.079944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e39494-004d-4c9d-83d9-08528e7710a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:30.143063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8e39494-004d-4c9d-83d9-08528e7710a1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:30.144250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8e39494-004d-4c9d-83d9-08528e7710a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:30.241516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 661/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:36:30.279824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:30.281373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:30.391673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1db2e2-ce1b-4fc2-bfe9-f21b567fbd8b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:30.473690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:30.474348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:30.474631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:30.474909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:30.476739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:30.594390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:30.596113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f448db-b08c-475f-b518-cf99a56d393e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:30.614381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 679/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:35.089910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:35.090477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:35.090477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:35.091804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 662/1341] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:35.097438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997d40-2c0f-48b3-9d18-b130d97fca16 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:35.097935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997d40-2c0f-48b3-9d18-b130d97fca16 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:35.098089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d997d40-2c0f-48b3-9d18-b130d97fca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:35.173515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6d997d40-2c0f-48b3-9d18-b130d97fca16 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:35.174737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6d997d40-2c0f-48b3-9d18-b130d97fca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:35.282002 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 680/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:36:35.320146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:35.322914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:35.422983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a94d7-bec2-426d-9214-6fd4cd2f93eb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:35.426973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:35.427738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:35.428032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:35.428315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:35.440129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:35.441868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae885435-b3e8-4df2-b2ce-0b68b049008d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:35.452504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 663/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:36:38.327717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744b51-1415-4a57-954f-4cd5acfa0890 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:38.328248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744b51-1415-4a57-954f-4cd5acfa0890 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:38.328595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70744b51-1415-4a57-954f-4cd5acfa0890 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:38.331182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 681/1344] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:38.337021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b0b1-8151-4e87-a2da-d50e61b16618 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:38.337713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b0b1-8151-4e87-a2da-d50e61b16618 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:38.338415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b0b1-8151-4e87-a2da-d50e61b16618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:38.369085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1755b0b1-8151-4e87-a2da-d50e61b16618 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:38.370470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1755b0b1-8151-4e87-a2da-d50e61b16618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:38.459405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 664/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:38.496095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70744b51-1415-4a57-954f-4cd5acfa0890 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:38.507014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70744b51-1415-4a57-954f-4cd5acfa0890 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:38.511965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:38.512623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:38.512913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:38.513196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:38.522854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:38.524821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925690c-e218-495f-977b-41188d50f1d6 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:38.534476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 682/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:36:43.188606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10d89-fedd-4489-8c38-1ea230bec758 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:43.189514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10d89-fedd-4489-8c38-1ea230bec758 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:43.189793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10d89-fedd-4489-8c38-1ea230bec758 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:43.191352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 665/1347] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:43.199840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da20e-19b4-4d65-b1a9-0cf409bfeb44 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:43.200359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da20e-19b4-4d65-b1a9-0cf409bfeb44 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:43.200602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da20e-19b4-4d65-b1a9-0cf409bfeb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:43.220211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-481da20e-19b4-4d65-b1a9-0cf409bfeb44 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:43.221858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-481da20e-19b4-4d65-b1a9-0cf409bfeb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:43.235873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 683/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:43.273624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10d89-fedd-4489-8c38-1ea230bec758 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:43.285229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10d89-fedd-4489-8c38-1ea230bec758 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:43.289860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:43.290748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:43.291228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:43.291708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:43.301915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:43.303521 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025384c-a1f4-4a92-85b5-947aa29fad6f service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:43.314655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 666/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:36:48.752561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4db1-5654-4346-a3bf-9be596972af0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:48.753363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4db1-5654-4346-a3bf-9be596972af0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:48.753653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4db1-5654-4346-a3bf-9be596972af0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:48.755198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 684/1350] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:48.761371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae5ff-492c-414d-b08f-2a9cc4ae10f5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:48.763039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae5ff-492c-414d-b08f-2a9cc4ae10f5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:48.763507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dae5ff-492c-414d-b08f-2a9cc4ae10f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:48.871173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-87dae5ff-492c-414d-b08f-2a9cc4ae10f5 None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:48.872934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-87dae5ff-492c-414d-b08f-2a9cc4ae10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:49.001213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 667/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:36:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:53.784297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f28a5f-829a-453e-9333-9aa192fcebf9 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:53.785705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f28a5f-829a-453e-9333-9aa192fcebf9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:53.786453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f28a5f-829a-453e-9333-9aa192fcebf9 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:53.788192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 685/1352] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:53.794289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd5de-4872-4615-bbfd-f6ab2c96ffbf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:53.794845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd5de-4872-4615-bbfd-f6ab2c96ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:53.795450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dd5de-4872-4615-bbfd-f6ab2c96ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:53.816544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-710dd5de-4872-4615-bbfd-f6ab2c96ffbf None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:53.817629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-710dd5de-4872-4615-bbfd-f6ab2c96ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:53.827855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 668/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:36:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:55.256883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb843-ab75-4ece-9c8a-26c2d0588383 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:55.257951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb843-ab75-4ece-9c8a-26c2d0588383 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:55.258049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb843-ab75-4ece-9c8a-26c2d0588383 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:55.259567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 686/1354] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:36:55.264617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52f3c-e687-4a0b-8dff-96d09f3b147a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:55.265108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52f3c-e687-4a0b-8dff-96d09f3b147a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:55.265364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e52f3c-e687-4a0b-8dff-96d09f3b147a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:55.284570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f8e52f3c-e687-4a0b-8dff-96d09f3b147a None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:55.285773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f8e52f3c-e687-4a0b-8dff-96d09f3b147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:55.294724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 669/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:36:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:59.188122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c60c2-13aa-40b2-9150-fbe9ae817fb0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:59.188652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c60c2-13aa-40b2-9150-fbe9ae817fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:59.188652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c60c2-13aa-40b2-9150-fbe9ae817fb0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:59.190171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 687/1356] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:59.196284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cde4df-1bf9-4d18-8d28-0cc73c83d4b9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:59.196755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cde4df-1bf9-4d18-8d28-0cc73c83d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:59.196851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cde4df-1bf9-4d18-8d28-0cc73c83d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:59.214640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e6cde4df-1bf9-4d18-8d28-0cc73c83d4b9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:59.216022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e6cde4df-1bf9-4d18-8d28-0cc73c83d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:59.224119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 670/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:59.274995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e074-78c7-41ee-8b60-faa788bcdd81 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:59.275537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e074-78c7-41ee-8b60-faa788bcdd81 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:59.275962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1e074-78c7-41ee-8b60-faa788bcdd81 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:59.277655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 688/1358] 10.222.0.60 () {54 vars in 961 bytes} [Tue May 10 17:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:36:59.283472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede914-8daa-423b-b50d-dda4a4f83781 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:59.283900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede914-8daa-423b-b50d-dda4a4f83781 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:59.284307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede914-8daa-423b-b50d-dda4a4f83781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:59.338388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-45ede914-8daa-423b-b50d-dda4a4f83781 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:36:59.339899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-45ede914-8daa-423b-b50d-dda4a4f83781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:36:59.445617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 671/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Tue May 10 17:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:36:59.455760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e074-78c7-41ee-8b60-faa788bcdd81 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:36:59.471173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1e074-78c7-41ee-8b60-faa788bcdd81 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:36:59.477840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:36:59.478500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:36:59.479080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:36:59.479390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:36:59.489023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:36:59.490952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16280bc-44db-46b0-872f-529d06b12a5f service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:36:59.502697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 689/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:37:02.017426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073eb5-96ad-40fa-80e5-970eebe29ffc None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:02.018051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073eb5-96ad-40fa-80e5-970eebe29ffc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:02.018051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a073eb5-96ad-40fa-80e5-970eebe29ffc None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:02.019647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 672/1361] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:02.025614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0934d-b479-4445-af9b-6fedb57944a5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:02.026122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0934d-b479-4445-af9b-6fedb57944a5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:02.026238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0934d-b479-4445-af9b-6fedb57944a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:02.047305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-31b0934d-b479-4445-af9b-6fedb57944a5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:02.048599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-31b0934d-b479-4445-af9b-6fedb57944a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:02.063443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 690/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:02.111537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a073eb5-96ad-40fa-80e5-970eebe29ffc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:02.135599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a073eb5-96ad-40fa-80e5-970eebe29ffc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:02.145553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:02.147561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:02.147561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:02.148976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:02.167299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:02.170448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d9f36-33c1-43d8-83a2-6aa42330bf4d service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:02.191435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 673/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:04.940272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5e39-afcd-4620-a717-5d22d942dc4f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:04.940850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5e39-afcd-4620-a717-5d22d942dc4f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:04.940850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b5e39-afcd-4620-a717-5d22d942dc4f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:04.942487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 691/1364] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:04.948865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216040-a819-4054-8f9b-1826ee13c9b7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:04.949372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216040-a819-4054-8f9b-1826ee13c9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:04.949472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216040-a819-4054-8f9b-1826ee13c9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:04.968952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-35216040-a819-4054-8f9b-1826ee13c9b7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:04.970206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-35216040-a819-4054-8f9b-1826ee13c9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:04.978692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 674/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:05.025117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d334d9-3711-4664-aa58-c523c4438c1b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:05.025408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d334d9-3711-4664-aa58-c523c4438c1b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:05.025684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d334d9-3711-4664-aa58-c523c4438c1b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:05.027039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 692/1366] 10.222.0.60 () {54 vars in 961 bytes} [Tue May 10 17:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:05.032715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6942f7-540e-4b38-9c1b-bddebfbd9890 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:05.033084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6942f7-540e-4b38-9c1b-bddebfbd9890 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:05.033437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6942f7-540e-4b38-9c1b-bddebfbd9890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:05.053017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0e6942f7-540e-4b38-9c1b-bddebfbd9890 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:05.055042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0e6942f7-540e-4b38-9c1b-bddebfbd9890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:05.064928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 675/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Tue May 10 17:37:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:05.074082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d334d9-3711-4664-aa58-c523c4438c1b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:05.090282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d334d9-3711-4664-aa58-c523c4438c1b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:05.096184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:05.096862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:05.097153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:05.097438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:05.107210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:05.108990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f821c8-8558-423b-b95a-41a8c0cab3ce service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:05.119789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 693/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:37:07.581251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0d6d-000a-4bd6-bf09-b13a0afbefc4 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.581765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0d6d-000a-4bd6-bf09-b13a0afbefc4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.581765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0d6d-000a-4bd6-bf09-b13a0afbefc4 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.583098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 676/1369] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:07.589675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884260-b691-40b5-888a-c7c675ef82ed None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.590468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884260-b691-40b5-888a-c7c675ef82ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.590468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c884260-b691-40b5-888a-c7c675ef82ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.611495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6c884260-b691-40b5-888a-c7c675ef82ed None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:07.612932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6c884260-b691-40b5-888a-c7c675ef82ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:07.623031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 694/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:07.818420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006b4c-6295-422c-b379-5113f8656a7e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.818712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006b4c-6295-422c-b379-5113f8656a7e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.819770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006b4c-6295-422c-b379-5113f8656a7e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.821354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 677/1371] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:07.827200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0f2e-6211-4400-afe2-bc4a218e7743 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.827770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0f2e-6211-4400-afe2-bc4a218e7743 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.828044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d0f2e-6211-4400-afe2-bc4a218e7743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.855967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3d9d0f2e-6211-4400-afe2-bc4a218e7743 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:07.857131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3d9d0f2e-6211-4400-afe2-bc4a218e7743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:07.865622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 695/1372] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:07.911687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9006b4c-6295-422c-b379-5113f8656a7e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:07.926870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9006b4c-6295-422c-b379-5113f8656a7e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:07.933373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:07.934248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.935254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.935254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.957368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db826e-8314-4a12-8388-a9ddefb81ef3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.957826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db826e-8314-4a12-8388-a9ddefb81ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.958136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db826e-8314-4a12-8388-a9ddefb81ef3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.960424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 696/1373] 10.222.0.60 () {54 vars in 963 bytes} [Tue May 10 17:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:37:07.960994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:07.962828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:07.966194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681f01-e230-4c69-b5e5-0b6cb79600f4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:07.966493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681f01-e230-4c69-b5e5-0b6cb79600f4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:07.966861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35681f01-e230-4c69-b5e5-0b6cb79600f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:07.974624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 678/1374] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:08.032290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-35681f01-e230-4c69-b5e5-0b6cb79600f4 None None] MFA Rules not processed for user `0d12511650594add87c8753c0667d374`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:08.033580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-35681f01-e230-4c69-b5e5-0b6cb79600f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:08.109295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 697/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Tue May 10 17:37:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:08.120804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:08.130876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfab033-ee15-4fa2-9b24-49e56e839590 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:08.135439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:08.136117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:08.136412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:08.136689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:08.146911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:08.149364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77799511-e749-45e7-b398-4f4a93a70b18 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:08.161813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 679/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:37:10.336416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c1ad-d7ad-4ab5-a7e4-455e47c3669f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:10.337001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c1ad-d7ad-4ab5-a7e4-455e47c3669f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:10.337001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c1ad-d7ad-4ab5-a7e4-455e47c3669f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:10.338584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 698/1377] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:10.344225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798eff-73df-47af-919f-e92579a6be0c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:10.345105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798eff-73df-47af-919f-e92579a6be0c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:10.345389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39798eff-73df-47af-919f-e92579a6be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:10.365146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-39798eff-73df-47af-919f-e92579a6be0c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:10.366633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-39798eff-73df-47af-919f-e92579a6be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:10.374990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 680/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:10.419173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471c1ad-d7ad-4ab5-a7e4-455e47c3669f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:10.434880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471c1ad-d7ad-4ab5-a7e4-455e47c3669f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:10.440771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:10.441450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:10.441740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:10.442489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:10.452687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:10.454336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32fcad-a71b-4505-ba17-3721095d602a service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:10.467829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 699/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:12.814968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5372-32f2-4172-9d69-b014006eefc7 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:12.816045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5372-32f2-4172-9d69-b014006eefc7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:12.816590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e5372-32f2-4172-9d69-b014006eefc7 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:12.818324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 681/1380] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:12.824052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ce89-dcaf-4416-ae8e-3b2ba42270d4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:12.824613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ce89-dcaf-4416-ae8e-3b2ba42270d4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:12.824613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788ce89-dcaf-4416-ae8e-3b2ba42270d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:12.851196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2788ce89-dcaf-4416-ae8e-3b2ba42270d4 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:12.852594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2788ce89-dcaf-4416-ae8e-3b2ba42270d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:12.861056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 700/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:12.905215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e5372-32f2-4172-9d69-b014006eefc7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:12.922408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e5372-32f2-4172-9d69-b014006eefc7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:12.928390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:12.930061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:12.930470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:12.931526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:12.940964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:12.942973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59448d4e-4ec2-43fe-8a10-f7d36d2b944d service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:12.954959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 682/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:15.300267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e58e4-3265-4d47-9214-766bd678e6eb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:15.300859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e58e4-3265-4d47-9214-766bd678e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:15.300859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e58e4-3265-4d47-9214-766bd678e6eb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:15.302203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 701/1383] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:15.308476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69599-3c0a-4b14-bc3e-da80ffdec348 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:15.308975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69599-3c0a-4b14-bc3e-da80ffdec348 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:15.309077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69599-3c0a-4b14-bc3e-da80ffdec348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:15.329312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d7e69599-3c0a-4b14-bc3e-da80ffdec348 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:15.330519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7e69599-3c0a-4b14-bc3e-da80ffdec348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:15.339154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 683/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:15.380718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e58e4-3265-4d47-9214-766bd678e6eb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:15.396894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e58e4-3265-4d47-9214-766bd678e6eb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:15.403117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:15.403817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:15.404114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:15.404403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:15.414479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:15.416140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7f9e5-e640-4cc3-bf90-35d93c5a37a7 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:15.427160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 702/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:17.807300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f585f-9e7a-4d42-b9d7-d577992461ad None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:17.807924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f585f-9e7a-4d42-b9d7-d577992461ad None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:17.808042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f585f-9e7a-4d42-b9d7-d577992461ad None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:17.809938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 684/1386] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:17.817852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a6af-9bc4-4f24-ab74-56fd96db1b5a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:17.818388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a6af-9bc4-4f24-ab74-56fd96db1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:17.818564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a6af-9bc4-4f24-ab74-56fd96db1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:17.838370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d934a6af-9bc4-4f24-ab74-56fd96db1b5a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:17.839645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d934a6af-9bc4-4f24-ab74-56fd96db1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:17.847611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 703/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:17.893682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f585f-9e7a-4d42-b9d7-d577992461ad None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:17.909764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f585f-9e7a-4d42-b9d7-d577992461ad None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:17.916913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:17.917572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:17.917868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:17.918156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:17.927188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:17.929300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede40a26-25a4-4c7f-b140-97c33181c7c9 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:17.939486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 685/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:20.307841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae638-24a7-4d5e-9cb8-b79ab57a0a11 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:20.308608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae638-24a7-4d5e-9cb8-b79ab57a0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:20.308608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ae638-24a7-4d5e-9cb8-b79ab57a0a11 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:20.309915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 704/1389] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:20.315907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7663f2-1029-4afd-a508-54b2491c58c9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:20.316516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7663f2-1029-4afd-a508-54b2491c58c9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:20.316682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7663f2-1029-4afd-a508-54b2491c58c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:20.340461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0e7663f2-1029-4afd-a508-54b2491c58c9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:20.342033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0e7663f2-1029-4afd-a508-54b2491c58c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:20.353212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 686/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:20.400549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ae638-24a7-4d5e-9cb8-b79ab57a0a11 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:20.416759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ae638-24a7-4d5e-9cb8-b79ab57a0a11 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:20.423627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:20.424493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:20.424851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:20.425256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:20.437364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:20.439731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd1ba5-da4e-4007-9038-c4ed544276c3 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:20.453391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 705/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:22.791580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478059-d127-470a-9b4e-cc699031aa19 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:22.792206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478059-d127-470a-9b4e-cc699031aa19 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:22.792206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478059-d127-470a-9b4e-cc699031aa19 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:22.793539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 687/1392] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:22.799182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8c31-61c6-4a55-89fa-20d1193837af None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:22.799718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8c31-61c6-4a55-89fa-20d1193837af None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:22.799917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f8c31-61c6-4a55-89fa-20d1193837af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:22.819791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b01f8c31-61c6-4a55-89fa-20d1193837af None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:22.821496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b01f8c31-61c6-4a55-89fa-20d1193837af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:22.829943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 706/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:22.873928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478059-d127-470a-9b4e-cc699031aa19 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:22.888926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478059-d127-470a-9b4e-cc699031aa19 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:22.894688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:22.895333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:22.895649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:22.896550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:22.905014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:22.906606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4eee2-7935-474f-96a8-268ce702ab34 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:22.916641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 688/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:24.158254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6697-18e7-4582-8acd-9656c47402ff None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.158846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6697-18e7-4582-8acd-9656c47402ff None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.158846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6697-18e7-4582-8acd-9656c47402ff None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.160202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 707/1395] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:24.166093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462865c-d41c-4a0e-adce-06bf42c74ba6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.166606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462865c-d41c-4a0e-adce-06bf42c74ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.166704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462865c-d41c-4a0e-adce-06bf42c74ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.186024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b462865c-d41c-4a0e-adce-06bf42c74ba6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:24.187220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b462865c-d41c-4a0e-adce-06bf42c74ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:24.196073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 689/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:24.252701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619e37-7ffb-4e10-97e6-ee68141d9895 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.252991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619e37-7ffb-4e10-97e6-ee68141d9895 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.253266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619e37-7ffb-4e10-97e6-ee68141d9895 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.254628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 708/1397] 10.222.0.60 () {54 vars in 962 bytes} [Tue May 10 17:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:24.261428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbce4a-894e-4c0c-9198-e020c1330d2d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.261837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbce4a-894e-4c0c-9198-e020c1330d2d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.262178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbce4a-894e-4c0c-9198-e020c1330d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.314886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0ddbce4a-894e-4c0c-9198-e020c1330d2d None None] MFA Rules not processed for user `3860575c0bf3407198670e0f31ec2176`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:24.316147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0ddbce4a-894e-4c0c-9198-e020c1330d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:24.379705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 690/1398] 10.222.0.60 () {58 vars in 1059 bytes} [Tue May 10 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:24.387183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00619e37-7ffb-4e10-97e6-ee68141d9895 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:24.398342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00619e37-7ffb-4e10-97e6-ee68141d9895 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:24.402204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:24.402848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.403136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.403446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.413819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:24.415423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6b28-30e4-4da5-a970-00c207ec94fb service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:24.425519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 709/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:24.860154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1262-d459-4d51-a842-6581097d2bc4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:24.860471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1262-d459-4d51-a842-6581097d2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:24.860740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1262-d459-4d51-a842-6581097d2bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:24.908535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c7ce1262-d459-4d51-a842-6581097d2bc4 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:24.909760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c7ce1262-d459-4d51-a842-6581097d2bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:24.972693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 691/1400] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:37:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:25.021363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd825-1c70-47e2-bcd0-9f703300de92 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.021662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd825-1c70-47e2-bcd0-9f703300de92 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.022480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babd825-1c70-47e2-bcd0-9f703300de92 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.023974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 710/1401] 10.222.0.60 () {54 vars in 942 bytes} [Tue May 10 17:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:25.030740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612f84-e6d9-4258-952c-ca9f998b9464 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.031044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612f84-e6d9-4258-952c-ca9f998b9464 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.031336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95612f84-e6d9-4258-952c-ca9f998b9464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.080784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-95612f84-e6d9-4258-952c-ca9f998b9464 None None] MFA Rules not processed for user `e58f759fbae14125a0eb26807c8b98f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:25.082002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-95612f84-e6d9-4258-952c-ca9f998b9464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:25.158833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 692/1402] 10.222.0.60 () {58 vars in 1039 bytes} [Tue May 10 17:37:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:25.168623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babd825-1c70-47e2-bcd0-9f703300de92 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:25.182676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babd825-1c70-47e2-bcd0-9f703300de92 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:25.187982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:25.188403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d386a-d625-46e8-b0ca-e767f8acc623 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.188824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.188920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d386a-d625-46e8-b0ca-e767f8acc623 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.189008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.189105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d386a-d625-46e8-b0ca-e767f8acc623 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.189209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.190351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 693/1403] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:37:25.196574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809500c-308f-4750-a236-69d7c079c499 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.196861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809500c-308f-4750-a236-69d7c079c499 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.197132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809500c-308f-4750-a236-69d7c079c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.199034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:25.200842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:25.209911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 711/1404] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:37:25.216182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6809500c-308f-4750-a236-69d7c079c499 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:25.217391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6809500c-308f-4750-a236-69d7c079c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:25.225885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 694/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:25.270664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:25.287603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22389-a424-437e-93cd-46d979d2b78c service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:25.297912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:25.298574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:25.298859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:25.299133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:25.318421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:25.321513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c53453-1c12-497e-8e8b-6dc53d59cf50 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:25.334127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 712/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:27.897213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d85eb-995b-4b3c-8b6d-4681d136d19c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:27.898189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d85eb-995b-4b3c-8b6d-4681d136d19c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:27.898550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d85eb-995b-4b3c-8b6d-4681d136d19c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:27.900145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 695/1407] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:27.905603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96bb3-079d-41bf-9796-46db943b95d0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:27.906098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96bb3-079d-41bf-9796-46db943b95d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:27.906205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96bb3-079d-41bf-9796-46db943b95d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:27.925251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-81e96bb3-079d-41bf-9796-46db943b95d0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:27.926529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-81e96bb3-079d-41bf-9796-46db943b95d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:27.935189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 713/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:27.983288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d85eb-995b-4b3c-8b6d-4681d136d19c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:28.004067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d85eb-995b-4b3c-8b6d-4681d136d19c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:28.010918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:28.011789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:28.012083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:28.012370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:28.021597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:28.024517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de4868-c3cf-403a-9d08-5f7853223828 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:28.041354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 696/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:49.170599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ca7-39e4-43a9-b265-8c60f793e034 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:49.171316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ca7-39e4-43a9-b265-8c60f793e034 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:49.171316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902ca7-39e4-43a9-b265-8c60f793e034 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:49.172633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 714/1410] 10.222.0.60 () {54 vars in 918 bytes} [Tue May 10 17:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:49.179556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36018ac-ebbe-40ff-91f5-ee00b27fcb6f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:49.180349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36018ac-ebbe-40ff-91f5-ee00b27fcb6f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:49.180349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36018ac-ebbe-40ff-91f5-ee00b27fcb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:49.200616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f36018ac-ebbe-40ff-91f5-ee00b27fcb6f None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:49.201953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f36018ac-ebbe-40ff-91f5-ee00b27fcb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:49.211687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 697/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Tue May 10 17:37:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:49.230013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b17-dbbd-469a-ac17-4a7e3a931e15 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:49.230421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b17-dbbd-469a-ac17-4a7e3a931e15 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:49.230742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b17-dbbd-469a-ac17-4a7e3a931e15 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:49.232706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 715/1412] 10.222.0.60 () {54 vars in 918 bytes} [Tue May 10 17:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:49.238766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aba4-293a-4bf7-8ebe-eb809e5f8863 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:49.239093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aba4-293a-4bf7-8ebe-eb809e5f8863 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:49.239407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0aba4-293a-4bf7-8ebe-eb809e5f8863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:49.258596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bce0aba4-293a-4bf7-8ebe-eb809e5f8863 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:49.259875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bce0aba4-293a-4bf7-8ebe-eb809e5f8863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:49.269492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 698/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Tue May 10 17:37:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:52.022149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea26b-cbcf-46ac-9118-afdef68dde32 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:52.022755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea26b-cbcf-46ac-9118-afdef68dde32 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:52.022755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cea26b-cbcf-46ac-9118-afdef68dde32 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:52.024121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:52.029530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3110-fca9-4aea-8881-db439cc93e07 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:52.029959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3110-fca9-4aea-8881-db439cc93e07 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:52.030081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3110-fca9-4aea-8881-db439cc93e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:52.048749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-afba3110-fca9-4aea-8881-db439cc93e07 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:52.049944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-afba3110-fca9-4aea-8881-db439cc93e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:52.058014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:52.100190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cea26b-cbcf-46ac-9118-afdef68dde32 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:52.114749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cea26b-cbcf-46ac-9118-afdef68dde32 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:52.120362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:52.121012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:52.121328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:52.121797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:52.130107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:52.132573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9a6c-a721-4ad0-83c4-e73499e41eab service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:52.142020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 717/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:53.152332 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0052e-9bd5-49d4-a392-14bf44982fc8 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:53.152898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0052e-9bd5-49d4-a392-14bf44982fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:53.152898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0052e-9bd5-49d4-a392-14bf44982fc8 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:53.154174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:53.159496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a56d-e884-4969-ba6f-ef0a2fdfb498 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:53.160096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a56d-e884-4969-ba6f-ef0a2fdfb498 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:53.160096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a56d-e884-4969-ba6f-ef0a2fdfb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:53.179143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c4f6a56d-e884-4969-ba6f-ef0a2fdfb498 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:53.180405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4f6a56d-e884-4969-ba6f-ef0a2fdfb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:53.188485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:53.367418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0052e-9bd5-49d4-a392-14bf44982fc8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:53.382568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0052e-9bd5-49d4-a392-14bf44982fc8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:53.388171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:53.388826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:53.389117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:53.389400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:53.399280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:53.400963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6aae-323d-49ea-b8c4-3a028a023a67 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:53.410664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 701/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:54.388701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820369e2-fbfa-4dd7-a275-b985fe518bde None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:54.389402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820369e2-fbfa-4dd7-a275-b985fe518bde None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:54.389402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820369e2-fbfa-4dd7-a275-b985fe518bde None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:54.390651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:54.395779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f3e3-b22b-4adb-af0a-63668cc127f9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:54.396233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f3e3-b22b-4adb-af0a-63668cc127f9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:54.396497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42f3e3-b22b-4adb-af0a-63668cc127f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:54.414492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8f42f3e3-b22b-4adb-af0a-63668cc127f9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:54.415743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8f42f3e3-b22b-4adb-af0a-63668cc127f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:54.423583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:54.583606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820369e2-fbfa-4dd7-a275-b985fe518bde None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:54.600330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820369e2-fbfa-4dd7-a275-b985fe518bde None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:54.606136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:54.606804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:54.607098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:54.607404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:54.617284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:54.618903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07c86-b472-4001-be20-b889dff184c8 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:54.628743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 720/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:55.596813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf69b-e2b8-4ba6-9832-45967f650431 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:55.597341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf69b-e2b8-4ba6-9832-45967f650431 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:55.597341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdf69b-e2b8-4ba6-9832-45967f650431 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:55.599184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:55.605011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeef15-9152-4772-9a5f-7a7d66d3b674 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:55.605517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeef15-9152-4772-9a5f-7a7d66d3b674 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:55.605617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeef15-9152-4772-9a5f-7a7d66d3b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:55.624690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-16aeef15-9152-4772-9a5f-7a7d66d3b674 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:55.625913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-16aeef15-9152-4772-9a5f-7a7d66d3b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:55.634602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:55.783707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdf69b-e2b8-4ba6-9832-45967f650431 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:55.798426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdf69b-e2b8-4ba6-9832-45967f650431 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:55.804912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:55.805556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:55.805846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:55.806129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:55.814629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:55.816266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883d7f-3ceb-4adf-970a-bfe33bcd6c11 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:55.827496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 704/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:56.798060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc260cb-ab27-439b-9f81-59dde08a2664 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:56.798641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc260cb-ab27-439b-9f81-59dde08a2664 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:56.798641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc260cb-ab27-439b-9f81-59dde08a2664 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:56.800035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:56.805865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf60a9-5f99-4e11-91f1-6f12eb8c88b7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:56.806370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf60a9-5f99-4e11-91f1-6f12eb8c88b7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:56.806478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf60a9-5f99-4e11-91f1-6f12eb8c88b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:56.826090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f2bf60a9-5f99-4e11-91f1-6f12eb8c88b7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:56.827319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f2bf60a9-5f99-4e11-91f1-6f12eb8c88b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:56.835716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:57.002415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc260cb-ab27-439b-9f81-59dde08a2664 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:57.016538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc260cb-ab27-439b-9f81-59dde08a2664 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:57.022600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:57.023253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:57.023623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:57.023903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:57.032288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:57.033924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa627b6d-4854-4594-8ffb-086f1ab1e344 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:57.044793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 723/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:57.926988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023e781-e815-4aca-86d7-8f3e19a81e1c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:57.927682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023e781-e815-4aca-86d7-8f3e19a81e1c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:57.927682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023e781-e815-4aca-86d7-8f3e19a81e1c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:57.928992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:57.933915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb00c-aa4e-4511-93f5-62f2593b4c01 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:57.934334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb00c-aa4e-4511-93f5-62f2593b4c01 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:57.934517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cb00c-aa4e-4511-93f5-62f2593b4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:57.952782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ba2cb00c-aa4e-4511-93f5-62f2593b4c01 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:57.953979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ba2cb00c-aa4e-4511-93f5-62f2593b4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:57.962565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:37:58.113393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023e781-e815-4aca-86d7-8f3e19a81e1c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:58.127568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023e781-e815-4aca-86d7-8f3e19a81e1c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:58.133492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:58.134129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:58.134417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:58.134694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:58.142645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:58.144264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c751-938d-41ea-8a49-811a1c8e9acf service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:58.154675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 707/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:37:59.025008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff546-430b-4cc0-8057-519097bcf376 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:59.025600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff546-430b-4cc0-8057-519097bcf376 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:59.025600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ff546-430b-4cc0-8057-519097bcf376 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:59.026934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:37:59.031870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6df8c-b54f-442e-a4cd-435a03361206 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:59.032279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6df8c-b54f-442e-a4cd-435a03361206 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:59.032441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6df8c-b54f-442e-a4cd-435a03361206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:59.050713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e8a6df8c-b54f-442e-a4cd-435a03361206 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:37:59.051945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e8a6df8c-b54f-442e-a4cd-435a03361206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:37:59.060524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:37:59.209259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ff546-430b-4cc0-8057-519097bcf376 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:37:59.223537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ff546-430b-4cc0-8057-519097bcf376 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:37:59.229664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:37:59.230319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:37:59.230605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:37:59.230886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:37:59.239260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:37:59.240892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f69c3-d4a1-4879-8a17-12a05053a6f3 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:37:59.250173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 726/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:00.160195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d129-462b-4087-a3d6-24d19a900798 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:00.160731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d129-462b-4087-a3d6-24d19a900798 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:00.160731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d129-462b-4087-a3d6-24d19a900798 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:00.162756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:00.168038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba692db-65a5-4885-b308-04b413a2a083 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:00.168520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba692db-65a5-4885-b308-04b413a2a083 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:00.168628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba692db-65a5-4885-b308-04b413a2a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:00.186754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9ba692db-65a5-4885-b308-04b413a2a083 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:00.187985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ba692db-65a5-4885-b308-04b413a2a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:00.196221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:00.351969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d129-462b-4087-a3d6-24d19a900798 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:00.366433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d129-462b-4087-a3d6-24d19a900798 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:00.371902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:00.372540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:00.372829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:00.373103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:00.381864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:00.383470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d4565-4cab-4813-a5ed-5d6e1f74f61d service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:00.393335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 710/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:01.267105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6bb2-9ebd-48e6-853b-9929709af805 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:01.267719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6bb2-9ebd-48e6-853b-9929709af805 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:01.267719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe6bb2-9ebd-48e6-853b-9929709af805 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:01.269538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:01.275483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdea3e-7a1c-4366-89f6-68d7b06206bb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:01.275923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdea3e-7a1c-4366-89f6-68d7b06206bb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:01.276071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdea3e-7a1c-4366-89f6-68d7b06206bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:01.293905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-becdea3e-7a1c-4366-89f6-68d7b06206bb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:01.295107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-becdea3e-7a1c-4366-89f6-68d7b06206bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:01.303008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:01.455776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6bb2-9ebd-48e6-853b-9929709af805 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:01.470122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe6bb2-9ebd-48e6-853b-9929709af805 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:01.476675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:01.477327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:01.477619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:01.477902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:01.486494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:01.488142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba6d6e-58d0-4cba-96a7-b2dbd0ac91de service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:01.498789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 729/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:03.597585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c4c3-23d4-46ef-8958-8d57e787475f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:03.598144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c4c3-23d4-46ef-8958-8d57e787475f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:03.598144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512c4c3-23d4-46ef-8958-8d57e787475f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:03.600069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:03.605899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c691-3da2-4135-a74b-48bc043656c8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:03.606362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c691-3da2-4135-a74b-48bc043656c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:03.606487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509c691-3da2-4135-a74b-48bc043656c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:03.623836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1509c691-3da2-4135-a74b-48bc043656c8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:03.625016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1509c691-3da2-4135-a74b-48bc043656c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:03.633284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:03.671750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c4c3-23d4-46ef-8958-8d57e787475f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:03.682980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512c4c3-23d4-46ef-8958-8d57e787475f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:03.686607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:03.687245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:03.687562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:03.687844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:03.697619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:03.699054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ecbf-9cc8-4f51-847b-24f6e31eddaa service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:03.708628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 713/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:06.101224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-a210-41b5-b937-e16f2a102bd5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:06.101767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-a210-41b5-b937-e16f2a102bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:06.101767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-a210-41b5-b937-e16f2a102bd5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:06.103097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:06.108410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe06d4-6a05-4dea-82e0-ec07f7a56639 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:06.108830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe06d4-6a05-4dea-82e0-ec07f7a56639 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:06.109042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe06d4-6a05-4dea-82e0-ec07f7a56639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:06.127990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3dfe06d4-6a05-4dea-82e0-ec07f7a56639 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:06.129216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3dfe06d4-6a05-4dea-82e0-ec07f7a56639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:06.137782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:06.176481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8544b4-a210-41b5-b937-e16f2a102bd5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:06.187659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8544b4-a210-41b5-b937-e16f2a102bd5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:06.191229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:06.191902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:06.192194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:06.192732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:06.202093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:06.203609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998bd2-1fe6-4faa-9dc2-c0ce2690abca service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:06.213019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 732/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:38:08.746151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818fc5-6b69-40d7-91b8-125ed54e3d22 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:08.746843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818fc5-6b69-40d7-91b8-125ed54e3d22 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:08.746843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818fc5-6b69-40d7-91b8-125ed54e3d22 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:08.748152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:08.753378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2b94-9529-48c9-b5e2-c43040ef10d6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:08.753786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2b94-9529-48c9-b5e2-c43040ef10d6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:08.753940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b2b94-9529-48c9-b5e2-c43040ef10d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:08.771413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f03b2b94-9529-48c9-b5e2-c43040ef10d6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:08.772593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f03b2b94-9529-48c9-b5e2-c43040ef10d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:08.780338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:08.819516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818fc5-6b69-40d7-91b8-125ed54e3d22 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:08.830136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818fc5-6b69-40d7-91b8-125ed54e3d22 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:08.834196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:08.834852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:08.835140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:08.835459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:08.844763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:08.846202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0934b-5016-4ab6-8cd0-f7e792ade9f9 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:08.858160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 716/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:11.197643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:11.198211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:11.198211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:11.199634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:11.204988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5b97-a7f3-4fbf-9269-dd69758b88cd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:11.205415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5b97-a7f3-4fbf-9269-dd69758b88cd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:11.205549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5b97-a7f3-4fbf-9269-dd69758b88cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:11.223717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8fbc5b97-a7f3-4fbf-9269-dd69758b88cd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:11.224918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8fbc5b97-a7f3-4fbf-9269-dd69758b88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:11.233379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:38:11.279082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:11.280925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:11.294768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc553a9-4c72-425b-a4f8-1700b29e23cb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:11.298392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:11.299040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:11.299331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:11.299647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:11.308649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:11.310091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8140de-f122-4ee2-ac7c-83eba864e0bb service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:11.320309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 735/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:13.670077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680984-f981-4eda-aa64-f5868a04e39e None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:13.670629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680984-f981-4eda-aa64-f5868a04e39e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:13.670629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680984-f981-4eda-aa64-f5868a04e39e None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:13.672148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:13.677449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd07a5-6804-4f75-8d74-e1e8fb3dce3f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:13.677909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd07a5-6804-4f75-8d74-e1e8fb3dce3f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:13.678020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd07a5-6804-4f75-8d74-e1e8fb3dce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:13.695876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-36fd07a5-6804-4f75-8d74-e1e8fb3dce3f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:13.697067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-36fd07a5-6804-4f75-8d74-e1e8fb3dce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:13.704803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:13.742698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680984-f981-4eda-aa64-f5868a04e39e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:13.753225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680984-f981-4eda-aa64-f5868a04e39e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:13.756867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:13.757497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:13.757781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:13.758057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:13.766604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:13.768056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f11d6a-4777-4bf0-9450-ae88cdc87646 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:13.777681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 719/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:16.100601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad4d-a9bb-4a09-9fee-64c7af83a260 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:16.101121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad4d-a9bb-4a09-9fee-64c7af83a260 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:16.101121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880ad4d-a9bb-4a09-9fee-64c7af83a260 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:16.102464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:38:16.107934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a3c28-285c-49c1-a5e8-21b290acfbc5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:16.108362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a3c28-285c-49c1-a5e8-21b290acfbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:16.108503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a3c28-285c-49c1-a5e8-21b290acfbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:16.125877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8a7a3c28-285c-49c1-a5e8-21b290acfbc5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:16.127077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8a7a3c28-285c-49c1-a5e8-21b290acfbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:16.135040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:16.172586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ad4d-a9bb-4a09-9fee-64c7af83a260 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:16.184090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880ad4d-a9bb-4a09-9fee-64c7af83a260 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:16.187689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:16.188331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:16.188622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:16.188933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:16.198847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:16.200328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fb08b-8c11-4ebd-aa41-9f6e6f312960 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:16.209812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 738/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:18.476721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057e8a-0cd2-4532-993a-328958b42eca None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:18.477299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057e8a-0cd2-4532-993a-328958b42eca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:18.477299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057e8a-0cd2-4532-993a-328958b42eca None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:18.478655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:18.484117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065094a9-76f1-4ee8-b019-42919a844cb7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:18.484565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065094a9-76f1-4ee8-b019-42919a844cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:18.484669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065094a9-76f1-4ee8-b019-42919a844cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:18.501921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-065094a9-76f1-4ee8-b019-42919a844cb7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:18.503123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-065094a9-76f1-4ee8-b019-42919a844cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:18.511682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:18.548296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66057e8a-0cd2-4532-993a-328958b42eca None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:18.559008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66057e8a-0cd2-4532-993a-328958b42eca None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:18.565107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:18.565766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:18.566060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:18.566338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:18.577036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:18.578546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479661f3-2f51-4ca9-a983-51b8199cd41a service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:18.588722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 722/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:38:20.871106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e468-46b7-4fb9-a76b-bde92ee13819 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:20.871690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e468-46b7-4fb9-a76b-bde92ee13819 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:20.871690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5e468-46b7-4fb9-a76b-bde92ee13819 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:20.873113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:20.878392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e380-6ee8-4c81-949b-4ebaa37b4558 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:20.878793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e380-6ee8-4c81-949b-4ebaa37b4558 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:20.878950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e380-6ee8-4c81-949b-4ebaa37b4558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:20.896780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-caf7e380-6ee8-4c81-949b-4ebaa37b4558 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:20.897986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-caf7e380-6ee8-4c81-949b-4ebaa37b4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:20.905797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:38:20.943302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5e468-46b7-4fb9-a76b-bde92ee13819 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:20.954078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5e468-46b7-4fb9-a76b-bde92ee13819 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:20.958031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:20.958679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:20.958971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:20.959251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:20.968149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:20.969584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a943f46-acdc-410c-a92e-99084e1897d6 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:20.979468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 741/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:23.215485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2d2c-7603-49a9-8b55-6e5f69de26ca None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:23.216056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2d2c-7603-49a9-8b55-6e5f69de26ca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:23.216056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c2d2c-7603-49a9-8b55-6e5f69de26ca None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:23.217782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:23.223122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06626d0-e5e7-4488-b83c-9d88898fe129 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:23.223652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06626d0-e5e7-4488-b83c-9d88898fe129 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:23.223775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06626d0-e5e7-4488-b83c-9d88898fe129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:23.240988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e06626d0-e5e7-4488-b83c-9d88898fe129 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:23.242202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e06626d0-e5e7-4488-b83c-9d88898fe129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:23.250022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:23.287093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c2d2c-7603-49a9-8b55-6e5f69de26ca None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:23.297766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c2d2c-7603-49a9-8b55-6e5f69de26ca None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:23.301851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:23.302500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:23.302798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:23.303061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:23.312104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:23.313534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec090-06a3-446f-8ed5-8e309aaad4bc service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:23.324142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 725/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:25.561410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859164-f73a-4d29-93e4-ca5ae1f46c65 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:25.561944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859164-f73a-4d29-93e4-ca5ae1f46c65 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:25.561944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859164-f73a-4d29-93e4-ca5ae1f46c65 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:25.563257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:25.569158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a05f-456d-4d83-adc0-da1e911df846 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:25.569623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a05f-456d-4d83-adc0-da1e911df846 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:25.569753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a05f-456d-4d83-adc0-da1e911df846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:25.588446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7365a05f-456d-4d83-adc0-da1e911df846 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:25.589641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7365a05f-456d-4d83-adc0-da1e911df846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:25.597654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:25.633348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859164-f73a-4d29-93e4-ca5ae1f46c65 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:25.643956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859164-f73a-4d29-93e4-ca5ae1f46c65 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:25.648156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:25.648800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:25.649090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:25.649373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:25.658496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:25.660044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8f9da-4c61-4d16-ae6b-8de5d3120d30 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:25.670658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 744/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:38:59.492633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542d86-f11a-44dc-8bc2-67cd57e6dad1 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:59.493215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542d86-f11a-44dc-8bc2-67cd57e6dad1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:59.493215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b542d86-f11a-44dc-8bc2-67cd57e6dad1 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:59.494478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 727/1471] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:59.499705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9751-067a-4981-9ddb-d63b6e1b076b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:59.500176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9751-067a-4981-9ddb-d63b6e1b076b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:59.500297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9751-067a-4981-9ddb-d63b6e1b076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:59.518700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1f5b9751-067a-4981-9ddb-d63b6e1b076b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:59.519949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1f5b9751-067a-4981-9ddb-d63b6e1b076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:59.527741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 745/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:38:59.575332 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c5be-271d-4ac9-872b-5bab7a870fe7 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:59.575655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c5be-271d-4ac9-872b-5bab7a870fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:59.575939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876c5be-271d-4ac9-872b-5bab7a870fe7 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:59.577290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 728/1473] 10.222.0.60 () {54 vars in 962 bytes} [Tue May 10 17:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:38:59.582241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e983ed-0145-478a-a792-66088fe0167e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:59.582560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e983ed-0145-478a-a792-66088fe0167e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:59.582839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e983ed-0145-478a-a792-66088fe0167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:59.600378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e6e983ed-0145-478a-a792-66088fe0167e None None] MFA Rules not processed for user `3860575c0bf3407198670e0f31ec2176`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:38:59.601558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e6e983ed-0145-478a-a792-66088fe0167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:38:59.608033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 746/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Tue May 10 17:38:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:38:59.615860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c5be-271d-4ac9-872b-5bab7a870fe7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:38:59.626613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876c5be-271d-4ac9-872b-5bab7a870fe7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:38:59.630911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:38:59.631584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:38:59.631874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:38:59.632152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:38:59.640909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:38:59.642319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3c539-6c46-4dab-bcd1-fbccdd2b0777 service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:38:59.651715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 729/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:39:01.962649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153110a-7fd7-4466-82f6-0e6d3159abeb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:01.963222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153110a-7fd7-4466-82f6-0e6d3159abeb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:01.963222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153110a-7fd7-4466-82f6-0e6d3159abeb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:01.964621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 747/1476] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:01.969816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb684c-8885-44f0-911f-c510e6c706df None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:01.970286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb684c-8885-44f0-911f-c510e6c706df None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:01.970392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb684c-8885-44f0-911f-c510e6c706df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:01.988821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-aeeb684c-8885-44f0-911f-c510e6c706df None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:01.989992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aeeb684c-8885-44f0-911f-c510e6c706df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:01.997708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 730/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:02.020625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153110a-7fd7-4466-82f6-0e6d3159abeb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:02.032844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153110a-7fd7-4466-82f6-0e6d3159abeb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:02.037853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:02.038495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:02.038782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:02.039060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:02.039827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:02.041617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:39:02.041617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:39:02.041617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:39:02.042756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4293cc-da93-4477-ac36-a7a7d65fd6e1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:02.061839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 748/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Tue May 10 17:39:02 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:39:04.343532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce248-1687-40e6-b117-bff6e0cf9725 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:04.344106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce248-1687-40e6-b117-bff6e0cf9725 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:04.344106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce248-1687-40e6-b117-bff6e0cf9725 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:04.345503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 731/1479] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:04.351251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035444-0d14-4fe2-8695-fe1adc2984d3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:04.351759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035444-0d14-4fe2-8695-fe1adc2984d3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:04.351872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035444-0d14-4fe2-8695-fe1adc2984d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:04.369680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ff035444-0d14-4fe2-8695-fe1adc2984d3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:04.370876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ff035444-0d14-4fe2-8695-fe1adc2984d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:04.379377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 749/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:04.421058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ce248-1687-40e6-b117-bff6e0cf9725 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:04.435295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ce248-1687-40e6-b117-bff6e0cf9725 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:04.441508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:04.442152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:04.442424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:04.442694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:04.451336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:04.452942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c7e2b-8626-4750-a8c0-020b1eb37246 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:04.462866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 732/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:39:06.914413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deff869-26b0-4a85-8b94-53299391565f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:06.914999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deff869-26b0-4a85-8b94-53299391565f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:06.914999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deff869-26b0-4a85-8b94-53299391565f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:06.916374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 750/1482] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:06.921566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966e01-f66c-45d6-9b53-bbd189409895 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:06.922036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966e01-f66c-45d6-9b53-bbd189409895 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:06.922148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3966e01-f66c-45d6-9b53-bbd189409895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:06.940000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b3966e01-f66c-45d6-9b53-bbd189409895 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:06.941845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b3966e01-f66c-45d6-9b53-bbd189409895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:06.950009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 733/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:06.985272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deff869-26b0-4a85-8b94-53299391565f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:06.996347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deff869-26b0-4a85-8b94-53299391565f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:06.999820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:07.000450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:07.000732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:07.001010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:07.010511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:07.012050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c888b8-2658-40c8-9b34-1d3c1ddc9415 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:07.021497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 751/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:39:09.312243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eed24b-900f-44fe-8551-b4ca66a39046 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:09.312807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eed24b-900f-44fe-8551-b4ca66a39046 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:09.312905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eed24b-900f-44fe-8551-b4ca66a39046 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:09.314248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 734/1485] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:09.320677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093e3c-0366-4c61-a581-7eddfaa8cb84 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:09.321142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093e3c-0366-4c61-a581-7eddfaa8cb84 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:09.321260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093e3c-0366-4c61-a581-7eddfaa8cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:09.338908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-00093e3c-0366-4c61-a581-7eddfaa8cb84 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:09.340261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-00093e3c-0366-4c61-a581-7eddfaa8cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:09.348514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 752/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:09.386765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eed24b-900f-44fe-8551-b4ca66a39046 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:09.397624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eed24b-900f-44fe-8551-b4ca66a39046 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:09.401239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:09.401880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:09.402167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:09.402447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:09.412089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:09.413718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b70e-640a-402b-a3ee-42f59175e2d3 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:09.423943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 735/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:39:11.757261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74b35-324b-4c90-badc-2305ad8681cc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:11.757867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74b35-324b-4c90-badc-2305ad8681cc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:11.757867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74b35-324b-4c90-badc-2305ad8681cc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:11.759175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 753/1488] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:11.764388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e87b-938b-4230-8e5e-2fe0e4e4af3f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:11.764835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e87b-938b-4230-8e5e-2fe0e4e4af3f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:11.764944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992e87b-938b-4230-8e5e-2fe0e4e4af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:11.782185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3992e87b-938b-4230-8e5e-2fe0e4e4af3f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:11.783393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3992e87b-938b-4230-8e5e-2fe0e4e4af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:11.791961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 736/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:11.831674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d74b35-324b-4c90-badc-2305ad8681cc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:11.842387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d74b35-324b-4c90-badc-2305ad8681cc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:11.845875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:11.846510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:11.846795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:11.847748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:11.856543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:11.857972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbeb972-2fce-43a1-a713-9368307ef970 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:11.868153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 754/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:39:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:39:14.282405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c64c-1a2f-4bb3-a44b-289c6ead071f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:14.283000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c64c-1a2f-4bb3-a44b-289c6ead071f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:14.283000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1c64c-1a2f-4bb3-a44b-289c6ead071f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:14.284920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 737/1491] 10.222.0.60 () {54 vars in 926 bytes} [Tue May 10 17:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:39:14.290211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9eac1-a064-4048-9a37-c034210e047f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:14.290662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9eac1-a064-4048-9a37-c034210e047f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:14.290812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9eac1-a064-4048-9a37-c034210e047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:14.309110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-30f9eac1-a064-4048-9a37-c034210e047f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:39:14.310323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30f9eac1-a064-4048-9a37-c034210e047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:39:14.318587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 755/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Tue May 10 17:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:39:14.356818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1c64c-1a2f-4bb3-a44b-289c6ead071f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:39:14.367772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1c64c-1a2f-4bb3-a44b-289c6ead071f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:39:14.371265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:39:14.371936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:39:14.372225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:39:14.372505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:39:14.381560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:39:14.383000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129e8df-be48-4d55-a768-2d718070c8ee service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:39:14.392633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 738/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:40:42.587784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.588393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.588393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.606208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:40:42.607636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:42.615864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 756/1494] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:40:42.625115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.626429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.626429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.644755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:40:42.645969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:42.653802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 739/1495] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:40:42.658600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.668238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb56ce7-22c8-452e-a0bf-8d3d72068c39 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.672846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.673514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.673800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.674080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.674818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:40:42.675128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.676186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.676186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:40:42.676186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:40:42.677069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.689217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 757/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:40:42.698836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.709121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86345dc3-f5fb-427a-9b43-92cd22980d20 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.713852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.714519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.714808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.715089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.715838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.717653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.717653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:40:42.717653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:40:42.718858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.756197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 740/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:40:42 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:40:42.760816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.772162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85533f-2847-4e36-9228-5d2921d1a66a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.836625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.837313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.837599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.837927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.838593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.839663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.839663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:40:42.839663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:40:42.840899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.864348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 758/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:40:42 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:40:42.868142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.879151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29988ee-0f30-42d0-bf97-25befbc4a6c1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.883848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.884512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.884794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.885107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.885835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.886840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.886840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:40:42.886840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:40:42.887770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.901661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 741/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:40:42.905794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.915968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aedff3-9982-41d2-988b-44669403db14 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.920885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.921548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.921832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.922111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.923479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.924530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.924530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:40:42.924530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:40:42.925489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e262a-2a36-46cb-9db4-bcb9c23dff9a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.939485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 759/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:40:42.943691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:42.955004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4e3e-a6a6-4706-8157-5429d9cdab7e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:42.959749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:42.960643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:42.960932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:42.961216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] PATH_INFO: `/v3/projects/6697c7bfeaf04f9594767132c0675f6a/users/1db047c75963491a912903fc4cdc949a/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:42.976440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6697c7bfeaf04f9594767132c0675f6a, user_id=1db047c75963491a912903fc4cdc949a, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:42.977514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:42.977514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:40:42.977514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:40:42.979545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924d3f2-0660-453d-877b-99e2e42f09a6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:42.992919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 742/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:40:42 2022] PUT /identity/v3/projects/6697c7bfeaf04f9594767132c0675f6a/users/1db047c75963491a912903fc4cdc949a/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:40:43.005231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4debe-c6ce-4556-a77f-f92ade397798 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.005523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4debe-c6ce-4556-a77f-f92ade397798 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.005806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4debe-c6ce-4556-a77f-f92ade397798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.031353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9fa4debe-c6ce-4556-a77f-f92ade397798 None None] MFA Rules not processed for user `1db047c75963491a912903fc4cdc949a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:40:43.032823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9fa4debe-c6ce-4556-a77f-f92ade397798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:43.094834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 760/1502] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:40:43.108249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0fb58-b12c-4b23-a5e6-b55a4e6877bc None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.108549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0fb58-b12c-4b23-a5e6-b55a4e6877bc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.108834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0fb58-b12c-4b23-a5e6-b55a4e6877bc None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.110752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 743/1503] 10.222.0.60 () {54 vars in 963 bytes} [Tue May 10 17:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:40:43.116328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375596-e891-423f-8069-a24a8c509917 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.116628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375596-e891-423f-8069-a24a8c509917 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.116913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375596-e891-423f-8069-a24a8c509917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.135628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-49375596-e891-423f-8069-a24a8c509917 None None] MFA Rules not processed for user `0d12511650594add87c8753c0667d374`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:40:43.136865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49375596-e891-423f-8069-a24a8c509917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:43.187070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 761/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Tue May 10 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:40:43.195802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0fb58-b12c-4b23-a5e6-b55a4e6877bc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:43.206503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0fb58-b12c-4b23-a5e6-b55a4e6877bc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:43.210105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:43.210753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.211040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.211328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.220618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:43.222067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:43.231591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 744/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:40:43.276283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bbb53-1802-4599-9d90-396fb30f088b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.276582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bbb53-1802-4599-9d90-396fb30f088b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.276869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bbb53-1802-4599-9d90-396fb30f088b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.278171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 762/1506] 10.222.0.60 () {52 vars in 829 bytes} [Tue May 10 17:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:40:43.282309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:43.347305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6c9b3-5237-4165-aa43-fdafeb6a8bf8 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:43.351815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:43.352690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.352979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.353256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] PATH_INFO: `/v3/users/1db047c75963491a912903fc4cdc949a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.354455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db047c75963491a912903fc4cdc949a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:43.355517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:43.355517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:40:43.355517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:40:43.356727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:43.424492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db047c75963491a912903fc4cdc949a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:43.425226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db047c75963491a912903fc4cdc949a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:43.443143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db047c75963491a912903fc4cdc949a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:43.444273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db047c75963491a912903fc4cdc949a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:43.454350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db047c75963491a912903fc4cdc949a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:43.475400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 745/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:40:43 2022] DELETE /identity/v3/users/1db047c75963491a912903fc4cdc949a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:40:43.480055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.480548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.480947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.501706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:40:43.503013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:43.567579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 763/1508] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:40:43.578217 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:43.580897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:43.647283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e131-d328-4657-9979-4142b3544bc1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:43.650918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:43.651706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:43.651994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:43.652272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:43.663028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:43.664541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fedd0-4a1c-4e50-b51c-2e002b01e7a6 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:43.675856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 746/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:40:44.021718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:40:44.023301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:40:44.035543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1108fee-68ed-4a8e-bdbf-ca6e689b4cff None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:40:44.040275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:40:44.041167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:40:44.041453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:40:44.041730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] PATH_INFO: `/v3/projects/6697c7bfeaf04f9594767132c0675f6a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:40:44.043059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6697c7bfeaf04f9594767132c0675f6a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:40:44.044107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:44.044107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:40:44.044107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:40:44.045304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:40:44.106390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6697c7bfeaf04f9594767132c0675f6a', 'request_id': 'req-dd9546d4-b3c3-4672-add6-809eeed5506b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:44.119911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6697c7bfeaf04f9594767132c0675f6a', 'request_id': 'req-dd9546d4-b3c3-4672-add6-809eeed5506b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:44.130453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6697c7bfeaf04f9594767132c0675f6a', 'request_id': 'req-dd9546d4-b3c3-4672-add6-809eeed5506b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:44.141016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] The token cache is being invalidate because project 6697c7bfeaf04f9594767132c0675f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:40:44.141826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:44.142562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dd9546d4-b3c3-4672-add6-809eeed5506b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:40:44.144143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 764/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:40:44 2022] DELETE /identity/v3/projects/6697c7bfeaf04f9594767132c0675f6a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:42:25.430303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:25.430921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:25.430921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:25.432297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:25.439279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c7bc-65dd-4c76-b2a2-4eb8aa11f460 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:25.439850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c7bc-65dd-4c76-b2a2-4eb8aa11f460 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:25.440032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c7bc-65dd-4c76-b2a2-4eb8aa11f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:25.460734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c1d3c7bc-65dd-4c76-b2a2-4eb8aa11f460 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:25.462000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c1d3c7bc-65dd-4c76-b2a2-4eb8aa11f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:25.527756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:25.705376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:25.707394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:25.790846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386552c5-e36e-46a7-a8e6-a72c0319dced None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:25.797517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:25.798196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:25.798488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:25.798774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:25.808253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:25.810912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab5eb4-1ffa-4254-b01e-276422ab6500 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:25.822809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 748/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:26.599156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5235a0-a43f-4857-ae6d-7e18a022a140 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:26.600022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5235a0-a43f-4857-ae6d-7e18a022a140 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:26.600022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5235a0-a43f-4857-ae6d-7e18a022a140 None None] PATH_INFO: `/v3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:26.601106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 766/1514] 10.222.0.77 () {54 vars in 925 bytes} [Tue May 10 17:42:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:42:26.608644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95293-84ff-49c8-bc97-f6049ff125b5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:26.609502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95293-84ff-49c8-bc97-f6049ff125b5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:26.609502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95293-84ff-49c8-bc97-f6049ff125b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:26.640853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5da95293-84ff-49c8-bc97-f6049ff125b5 None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:26.642791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5da95293-84ff-49c8-bc97-f6049ff125b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:26.735517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 749/1515] 10.222.0.77 () {58 vars in 1015 bytes} [Tue May 10 17:42:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:26.873368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af66a7-db50-4ff2-9c7c-e21368a48d49 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:26.873702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af66a7-db50-4ff2-9c7c-e21368a48d49 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:26.874050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af66a7-db50-4ff2-9c7c-e21368a48d49 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:26.875829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 767/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:26.881533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df46b3-a4d2-4de3-816d-3c06675bbefc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:26.881867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df46b3-a4d2-4de3-816d-3c06675bbefc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:26.882198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df46b3-a4d2-4de3-816d-3c06675bbefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:26.902908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-59df46b3-a4d2-4de3-816d-3c06675bbefc None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:26.905571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-59df46b3-a4d2-4de3-816d-3c06675bbefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:26.914225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 750/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:27.076832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af66a7-db50-4ff2-9c7c-e21368a48d49 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:27.092551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af66a7-db50-4ff2-9c7c-e21368a48d49 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:27.099764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:27.100553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:27.101028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:27.101500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:27.111331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:27.113047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a6422-e70a-4905-8209-335d68783829 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:27.124486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 768/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:36.351382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b994-1ba2-43e0-a11c-febaf64bdb90 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:36.352009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b994-1ba2-43e0-a11c-febaf64bdb90 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:36.352119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b994-1ba2-43e0-a11c-febaf64bdb90 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:36.353624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 751/1519] 10.222.0.60 () {54 vars in 960 bytes} [Tue May 10 17:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:36.359410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e40b-1612-4ff9-a495-01d2b601e874 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:36.359986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e40b-1612-4ff9-a495-01d2b601e874 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:36.360114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e40b-1612-4ff9-a495-01d2b601e874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:36.379791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1de5e40b-1612-4ff9-a495-01d2b601e874 None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:36.381067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1de5e40b-1612-4ff9-a495-01d2b601e874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:36.391392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 769/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Tue May 10 17:42:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:36.400371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b994-1ba2-43e0-a11c-febaf64bdb90 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:36.414782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b994-1ba2-43e0-a11c-febaf64bdb90 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:36.420046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:36.420761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:36.421092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:36.421411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:36.431291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:36.432951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a440-1e3b-4b23-8962-4b77add4f539 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:36.443677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 752/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:38.503553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0e27-738b-49f1-9963-7d0e9c4a6773 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:38.504169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0e27-738b-49f1-9963-7d0e9c4a6773 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:38.504276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0e27-738b-49f1-9963-7d0e9c4a6773 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:38.505663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:38.511096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809039-1caa-4a24-a88e-a78c090b4311 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:38.511604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809039-1caa-4a24-a88e-a78c090b4311 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:38.511794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49809039-1caa-4a24-a88e-a78c090b4311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:38.532937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-49809039-1caa-4a24-a88e-a78c090b4311 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:38.534179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-49809039-1caa-4a24-a88e-a78c090b4311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:38.542371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:38.696793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0e27-738b-49f1-9963-7d0e9c4a6773 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:38.712125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0e27-738b-49f1-9963-7d0e9c4a6773 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:38.718261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d283e5-5591-4872-b444-d2649908216c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:38.718923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d283e5-5591-4872-b444-d2649908216c service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:38.719211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d283e5-5591-4872-b444-d2649908216c service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:38.719531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d283e5-5591-4872-b444-d2649908216c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:38.728987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d283e5-5591-4872-b444-d2649908216c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:38.731159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d283e5-5591-4872-b444-d2649908216c service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:38.741003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 771/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:39.815594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a745-1a63-437a-94d9-4dd4b4799637 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:39.816197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a745-1a63-437a-94d9-4dd4b4799637 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:39.816197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a745-1a63-437a-94d9-4dd4b4799637 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:39.817565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 17:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:39.823832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e626c-d73b-4a66-90bd-acaef56a3acd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:39.824412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e626c-d73b-4a66-90bd-acaef56a3acd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:39.824412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e626c-d73b-4a66-90bd-acaef56a3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:39.853816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ae9e626c-d73b-4a66-90bd-acaef56a3acd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:39.855080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ae9e626c-d73b-4a66-90bd-acaef56a3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:39.864386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 17:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:40.047329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a745-1a63-437a-94d9-4dd4b4799637 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:40.063269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a745-1a63-437a-94d9-4dd4b4799637 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:40.072139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:40.073183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:40.073697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:40.074252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:40.090131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:40.093955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe8d46-7b1a-4dd2-9435-4fd69222e839 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:40.111499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 755/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:44.335654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:44.336532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:44.336714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:44.338288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:44.348261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e33f-559d-453b-a0d7-ab3228d47047 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:44.348865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e33f-559d-453b-a0d7-ab3228d47047 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:44.349251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e33f-559d-453b-a0d7-ab3228d47047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:44.379115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b964e33f-559d-453b-a0d7-ab3228d47047 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:44.380995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b964e33f-559d-453b-a0d7-ab3228d47047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:44.393922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:44.431802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:44.433590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:44.502737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d27eb3-0371-4087-bfc8-57860cde7bfc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:44.506579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:44.507249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:44.507590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:44.507853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:44.518062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:44.519578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598edc2f-29cb-461d-b02a-8751f1b3d054 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:44.531358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 774/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:46.896548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847754-e150-4147-a289-d39ae27990db None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:46.897137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847754-e150-4147-a289-d39ae27990db None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:46.897137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d847754-e150-4147-a289-d39ae27990db None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:46.898719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:46.906579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8810-c82c-4897-8089-9edc91d359aa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:46.907197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8810-c82c-4897-8089-9edc91d359aa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:46.907197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8810-c82c-4897-8089-9edc91d359aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:46.926590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6bff8810-c82c-4897-8089-9edc91d359aa None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:46.927874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6bff8810-c82c-4897-8089-9edc91d359aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:46.936046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:42:46.972935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d847754-e150-4147-a289-d39ae27990db None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:46.984102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d847754-e150-4147-a289-d39ae27990db None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:46.987849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:46.988506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:46.988793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:46.989069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:46.999196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:47.000690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ce9fd-9005-4f07-91d4-45dda92e7573 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:47.011816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 758/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:51.034169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:51.034811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:51.035412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:51.038364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:42:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:51.044518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f850-e9cc-411e-a6c0-5141194da5f9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:51.045098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f850-e9cc-411e-a6c0-5141194da5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:51.045098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f850-e9cc-411e-a6c0-5141194da5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:51.066415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1f33f850-e9cc-411e-a6c0-5141194da5f9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:51.067716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f33f850-e9cc-411e-a6c0-5141194da5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:51.077326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:42:51.368025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:51.371252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:51.452065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7b98-2a63-48e8-940c-56b72ccab4cb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:51.455966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:51.456648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:51.456935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:51.457217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:51.468019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:51.469498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17a6a-ae72-4e47-a1f7-c2b6c67d38c6 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:51.480191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 777/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:42:53.945697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:53.946336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:53.946336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:53.947739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 17:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:42:53.955081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250d2e-1b14-41b7-8f5b-df98391741b6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:53.955794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250d2e-1b14-41b7-8f5b-df98391741b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:53.955794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7250d2e-1b14-41b7-8f5b-df98391741b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:53.975157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f7250d2e-1b14-41b7-8f5b-df98391741b6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:42:53.976464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f7250d2e-1b14-41b7-8f5b-df98391741b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:53.985146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 17:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:42:54.268184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:42:54.270008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:42:54.284563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d14e-a814-4263-b99b-154516c41367 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:42:54.288314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:42:54.288993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:42:54.289291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:42:54.289577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:42:54.300632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:42:54.302321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cf658-ffaa-48cd-9bec-120c73895718 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:42:54.314918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 761/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:44:27.482380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d86c-2929-4215-963d-eb46ec5c68ae None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.483077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d86c-2929-4215-963d-eb46ec5c68ae None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.483077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2d86c-2929-4215-963d-eb46ec5c68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.513967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a8d2d86c-2929-4215-963d-eb46ec5c68ae None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.515417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a8d2d86c-2929-4215-963d-eb46ec5c68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.529924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 779/1540] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.555215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.556651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.556651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.589210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.590476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.605271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 762/1541] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.609466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ef2f-8db5-4a83-82f2-e31a4df9a8d0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.609797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ef2f-8db5-4a83-82f2-e31a4df9a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.610078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ef2f-8db5-4a83-82f2-e31a4df9a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.623451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:27.644857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2fbd5-f93b-41d8-97cb-f0bb4d0d5d90 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:27.655612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ad25ef2f-8db5-4a83-82f2-e31a4df9a8d0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.659694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad25ef2f-8db5-4a83-82f2-e31a4df9a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.663219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:27.664270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.664911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.666727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.667869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:27.668406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:27.669741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:27.669741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:44:27.669741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:44:27.671188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ad30f-83da-41cb-af98-3055b331e63c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:27.677913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 780/1542] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.679600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1a0-486b-4049-b690-822701ce94fd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.679987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1a0-486b-4049-b690-822701ce94fd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.680304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc1a0-486b-4049-b690-822701ce94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.698115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 763/1543] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:27.703741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.704377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.704884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.721960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-406bc1a0-486b-4049-b690-822701ce94fd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.723797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-406bc1a0-486b-4049-b690-822701ce94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.737066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.738658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.748117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 781/1544] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.751342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8a4a-f315-4cc4-9adc-4d560b893bde None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.752064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8a4a-f315-4cc4-9adc-4d560b893bde None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.752572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b8a4a-f315-4cc4-9adc-4d560b893bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.768704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 764/1545] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.770021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:27.794197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c09b6-1a42-42f1-b94d-592147417dd5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:27.794445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0a2b8a4a-f315-4cc4-9adc-4d560b893bde None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.795586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0a2b8a4a-f315-4cc4-9adc-4d560b893bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.800423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:27.801381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.801876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.802328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.803203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:27.804566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 782/1546] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.806571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f93f-4cae-445a-bde1-52697b51f552 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.807257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f93f-4cae-445a-bde1-52697b51f552 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.807257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f93f-4cae-445a-bde1-52697b51f552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.807972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:27.833074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6470f93f-4cae-445a-bde1-52697b51f552 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.834616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6470f93f-4cae-445a-bde1-52697b51f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.841626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 765/1547] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:27.843912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 783/1548] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.845646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:27.846358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f035f9-f32c-4fe2-9825-31810a9f7093 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.846653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f035f9-f32c-4fe2-9825-31810a9f7093 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.847017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f035f9-f32c-4fe2-9825-31810a9f7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.868190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-44f035f9-f32c-4fe2-9825-31810a9f7093 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.870561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-44f035f9-f32c-4fe2-9825-31810a9f7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.919452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8ae6-8116-463f-9caa-98a26f5f7eea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:27.926415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:27.927104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.927479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.927707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.928455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:27.928770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:27.930392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558c66e-a8c8-4b4f-bcfa-d4d18281a2f8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:27.935514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 784/1549] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.937228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1db5-343b-42dc-a676-075259e1b80a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.937595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1db5-343b-42dc-a676-075259e1b80a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.937957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1db5-343b-42dc-a676-075259e1b80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.949342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 766/1550] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:27.951202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6578d-c96e-415d-999c-fb30b103784a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.951852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6578d-c96e-415d-999c-fb30b103784a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.952347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6578d-c96e-415d-999c-fb30b103784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.964009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1a0c1db5-343b-42dc-a676-075259e1b80a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.965230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1a0c1db5-343b-42dc-a676-075259e1b80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.970832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-47e6578d-c96e-415d-999c-fb30b103784a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:27.972023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-47e6578d-c96e-415d-999c-fb30b103784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:27.973582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 785/1551] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.974830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.975122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.975426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.988408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 767/1552] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:27.997930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:27.997930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:27.997930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:27.999919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.001155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.017065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 786/1553] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.017065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.020008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28783eca-2fe3-4f43-ab06-5013f6f2585c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.023065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.024328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.026227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.027040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.027486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.027769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.028474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.030444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4961c-852f-4231-bbb5-096eab21091d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.033786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 768/1554] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.034589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.045225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dda40d-15c0-462a-877e-2b9d96a2b558 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.049900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.050537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.050825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.051102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.051733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 787/1555] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.051941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.052246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.053864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.056506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9325-e421-413a-89c2-a8d2049858b6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.056506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9325-e421-413a-89c2-a8d2049858b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.056759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9325-e421-413a-89c2-a8d2049858b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.066671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 769/1556] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.067586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.075616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-69da9325-e421-413a-89c2-a8d2049858b6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.076836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-69da9325-e421-413a-89c2-a8d2049858b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.079486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c8867-afd6-4f9b-bf71-441b86527773 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.084337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.089280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 788/1557] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.089449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.089449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.089449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.089729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559e2-e52e-4ead-aef4-ab1a8c64de80 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.089830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.089922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559e2-e52e-4ead-aef4-ab1a8c64de80 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.089922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5559e2-e52e-4ead-aef4-ab1a8c64de80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.090093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e08ec-e1f1-4871-b340-9dc8dcd4af62 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.105224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9e5559e2-e52e-4ead-aef4-ab1a8c64de80 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.106427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9e5559e2-e52e-4ead-aef4-ab1a8c64de80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.115070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 789/1558] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.118779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.118779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.118779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.119064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 770/1559] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.119245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.119574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.119865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.136604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.137640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:28.137812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.138806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:28.196238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 771/1560] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.197169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 790/1561] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:28.198090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.199688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.207618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40805c5-0bfc-4bbf-9823-4a894f542c81 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.209247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1ee45-1572-46fb-8179-aa9871615312 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.212743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.213413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.213702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.213983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.214719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.214832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.215495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.215824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.216109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.216367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.216844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.217161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.218747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.226181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 791/1562] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:28.226983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.231304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 772/1563] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.232854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.240784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3060-9bc1-4617-9404-74702e3c4492 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.246247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.246971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.247208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.247381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07707648-c553-44da-8417-9297ce152d2c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.247527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.248220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.249501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:28.249501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:44:28.249501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:44:28.250713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.252094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.252758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.253043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.253316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.254041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.254345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.255959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.268695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 773/1564] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.269575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.281266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 792/1565] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.281266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.284185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd24113-8a5c-445d-a9b4-2c4365447f3f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.344077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.344751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.345035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.345309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.345904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332b9db-e12a-4776-8302-9a30bf37d9e6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.346033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.346336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.348034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.350695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.351392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.351691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.352004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.353241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.355164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.369699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 774/1566] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.369699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.372773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fa6b3-a676-4ae6-a51a-09b65f45d89d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.380991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.380991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.380991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.380991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.381459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 793/1567] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.381553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.381553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.381695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.381994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.395584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42933d-b38f-4ec6-9d28-c94d60880789 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.396102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 775/1568] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.396858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.402267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.403019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.403605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.403914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.404852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:28.405100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.406729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.406983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523cd4-b66d-415d-bf07-52c076789711 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.411643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.412319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.412607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.412905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.413803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.416177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.421344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 794/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:28.422204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.429894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 776/1570] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:28.431555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.435943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24741b2e-19ca-42d3-bf0a-c145596c748b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.440910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.441588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.441803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f52ae-b688-4b24-bf9e-247789cbdae1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.441913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.442133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.442847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.444937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.447177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.447827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.448121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.448406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.449108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.451071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.473849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 795/1571] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.475116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.479584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 777/1572] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.480668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.546284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398e2b-72f1-40f1-b0a0-3cb6eecd3ebb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.546519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e0886-21e7-41b6-a4ad-6c0525806a3b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.551979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.552661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.552945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.553230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.553935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.556564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.561116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.562304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.562804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.563321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.564832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.568725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.583312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 778/1573] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.584238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.593859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 796/1574] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.594925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.604874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4005b-8d9e-4dbb-a399-046fb7eee3fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.644898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173dc9-165a-4811-b7e1-e5a8fa00b25a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.649586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.650378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.650667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.650946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.651711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.653313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.659248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.659945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.660232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.660512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.661200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.663262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.663429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 779/1575] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:28.664234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.674899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738faf7-8ce5-4cd4-8157-21670f72425f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.680010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.680897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.682002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.682324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.683130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.685096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.689972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 797/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.690862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.715092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 780/1577] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.716336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.761319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b19f8e-c47a-49c2-8322-0e3dfab79e16 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.777274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b8adb-f6ea-45dc-b189-4a8502c6aba0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.781974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.782658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.782944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.783223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.783959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.784979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:28.784979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:44:28.784979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:44:28.786204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.806763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 781/1578] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.807448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.817116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f140d-d0ad-45f5-8b8c-47f605d2ac4b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.821088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.822188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.822334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.822548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.822752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] PATH_INFO: `/v3/projects/f790b6e8a65a4f73867f613cc95b589d/users/4798885b96e246598c277df29198a0d2/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.822947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.823238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.823579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.824239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.826249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.838405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790b6e8a65a4f73867f613cc95b589d, user_id=4798885b96e246598c277df29198a0d2, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.839446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:28.839446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:44:28.839446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:44:28.842051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.849388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 782/1579] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.850683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.858420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 798/1580] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:28 2022] PUT /identity/v3/projects/f790b6e8a65a4f73867f613cc95b589d/users/4798885b96e246598c277df29198a0d2/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:28.859298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.863280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc679b1-056d-4c1d-b82c-9c4f3372ae21 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.924295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc721aa-0e65-4c18-bb92-46dcbcb0709c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.926635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.927323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.927643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.927942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.928619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.929134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.930005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.930306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.930549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.930663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.931422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.933024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.943949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 799/1581] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:28.944956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.951499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 783/1582] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.952449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.958103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dfa62-2b46-4b53-82eb-c3953ab13d7c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.962780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d410370-78d0-4a7c-b50a-26a0346f34b8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.965601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.966359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.966655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.967003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.967721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.968897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.969396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.969552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.969838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.970119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.970813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:28.972729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:28.980055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 800/1583] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:28.980980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.991510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a491738-1a8d-4d05-879a-362f5ebdc8e3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:28.993077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 784/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:28.993928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:28.997059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:28.997742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:28.998033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:28.998317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:28.999014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.000988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.003774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decdb4d-f3f4-49ab-bb00-8c17004eb870 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.008961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.009837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.010044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.010353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.011172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.013355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef7c8b-7a3d-46d8-b9e8-c3a51b619d1d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.022163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 801/1585] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:28 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:29.023212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.027358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 785/1586] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.027358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775089a-6e97-41a9-add5-c9765563890b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.027358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775089a-6e97-41a9-add5-c9765563890b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.027358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775089a-6e97-41a9-add5-c9765563890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.037055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639ca87-47ab-4b65-a0b5-8cd53d11dc3e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.042134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.042813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.043099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.043407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.044139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.045763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.052194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c775089a-6e97-41a9-add5-c9765563890b None None] MFA Rules not processed for user `4798885b96e246598c277df29198a0d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:29.053417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c775089a-6e97-41a9-add5-c9765563890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.061188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 802/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.061188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.072570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c77a-4e44-4a15-8a2e-d2abcca79b7e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.077268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.077926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.078209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.078490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.079227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.080957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.090836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 803/1588] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.091774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.101327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbae991-31d8-4ce9-bec9-bf3806a91aa9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.106636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.107296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.107631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.107931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.108675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.110275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.120726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 804/1589] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.121036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 786/1590] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:29.121521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.122295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775089a-6e97-41a9-add5-c9765563890b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.134427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775089a-6e97-41a9-add5-c9765563890b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.135694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce48e5-fa62-4d9c-8683-d87716548729 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.139008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.139706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.139993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.140204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.140322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.141006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.141110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.141340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.141614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] PATH_INFO: `/v3/projects/0461acfadf8743fdbd62a39bf3fe3e1c/users/ed37128b78a6454c9c387ad91995a05d/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.142722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.152716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 787/1591] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.153611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.156065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0461acfadf8743fdbd62a39bf3fe3e1c, user_id=ed37128b78a6454c9c387ad91995a05d, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.158768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.164935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811c44-be72-4f10-9338-21a600283f59 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.171176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.171999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.172221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.172502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.176633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 805/1592] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/0461acfadf8743fdbd62a39bf3fe3e1c/users/ed37128b78a6454c9c387ad91995a05d/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.176799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.176908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.177001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.186952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 788/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.187778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.197766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae736cd-2e82-4e16-bbd9-40daa118cee5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.237292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6c88e-5ff3-41e1-bfc0-c562c27f56ec admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.242496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.243733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.244171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.244662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.245425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.247080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.253588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.254263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.254548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.254823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.255585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.260853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 806/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.261031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.261163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.267947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 789/1595] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.268151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b03e-e48f-41f7-bc6d-1194624a3c99 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.269153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.272809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.273709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.273990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.274265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] PATH_INFO: `/v3/projects/98c641670665465caa49f5d709911793/users/ca6c3d8d36db4f5fbc6c24834f81f599/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.279905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08323de-5989-4aea-ae84-72cb1fbf82a2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.284616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.285279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.285570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.285850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.286580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.288736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.288866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c641670665465caa49f5d709911793, user_id=ca6c3d8d36db4f5fbc6c24834f81f599, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.292335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.301548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 790/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.302360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.309597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 807/1597] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/98c641670665465caa49f5d709911793/users/ca6c3d8d36db4f5fbc6c24834f81f599/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.310434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.312734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71086022-2c5d-40e3-bb17-d62758ca2166 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.367874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.369100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.369407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.369660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.370368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.372589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.373918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258262f-4e36-48b9-866b-ac6cfeb62364 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.378536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.379206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.379554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.379833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.380602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.382216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44611cfd-0474-46f1-a98d-e1bd6171511c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.393825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 808/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.395135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.395460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.395745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.399954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 791/1599] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:29.400246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.417659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:29.418876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.465008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed2668-5155-4c20-b379-485e207f8766 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.469866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.470549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.470838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.471121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.471896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.473499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.477291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 809/1600] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:29.479079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.487597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 792/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:29.488249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600add1a-7665-4ffa-a383-1d1209662216 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.488478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.492898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.493827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.494103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.494379 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] PATH_INFO: `/v3/projects/39a2edf9ed6b480a9863609f51689013/users/99eceaf1a3984d189ace4ce96827867c/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.498663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006de2e-da56-453e-a2df-035e31517950 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.503419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.504386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.504687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.504968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] PATH_INFO: `/v3/projects/f4e017a4040d450aad862065563ea64d/users/e6a99e5d684a48a2845d3379e7df812c/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.509202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a2edf9ed6b480a9863609f51689013, user_id=99eceaf1a3984d189ace4ce96827867c, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.512172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.520999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e017a4040d450aad862065563ea64d, user_id=e6a99e5d684a48a2845d3379e7df812c, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.523724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5cda35-d6ff-4f1a-92d4-7e4ebcde05c4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.527298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 810/1602] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/39a2edf9ed6b480a9863609f51689013/users/99eceaf1a3984d189ace4ce96827867c/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.528203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.540306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 793/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/f4e017a4040d450aad862065563ea64d/users/e6a99e5d684a48a2845d3379e7df812c/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.542274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.542567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.542848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.560536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:29.561856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.598259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d662ec-e662-4f50-b482-1598922ebb8c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.631231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 794/1604] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:29.632808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.642439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262692f-af0b-41a5-b1df-0c5dcfce8009 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.647961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.648877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.649170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.650191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] PATH_INFO: `/v3/projects/d14ee6e6a46c4220a3653c732ca222d7/users/a59c374bad30460cae95b0f66729a618/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.661155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.662498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.663834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.664304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] PATH_INFO: `/v3/projects/dd780ae610b8443b9aa035883f29c37b/users/2dcce9f3178344dba7ecaf751dd08713/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.667879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14ee6e6a46c4220a3653c732ca222d7, user_id=a59c374bad30460cae95b0f66729a618, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.670589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.684923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 795/1605] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/d14ee6e6a46c4220a3653c732ca222d7/users/a59c374bad30460cae95b0f66729a618/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.685819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.687306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd780ae610b8443b9aa035883f29c37b, user_id=2dcce9f3178344dba7ecaf751dd08713, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.690284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.705294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 811/1606] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/dd780ae610b8443b9aa035883f29c37b/users/2dcce9f3178344dba7ecaf751dd08713/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.705939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.757344 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328bb9-706f-48e6-823c-47e848807760 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.771076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d694cb-77c5-4c1f-9aa3-5820c8d04f05 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.777485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.778388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.778680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.778964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] PATH_INFO: `/v3/projects/ec9da2f35bcd444fa485c453103df5cc/users/93f2755bf7ac430f9380bf2cf3ecb97f/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.795880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9da2f35bcd444fa485c453103df5cc, user_id=93f2755bf7ac430f9380bf2cf3ecb97f, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.798563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.815012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 812/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:29 2022] PUT /identity/v3/projects/ec9da2f35bcd444fa485c453103df5cc/users/93f2755bf7ac430f9380bf2cf3ecb97f/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:29.815900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.816111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.816911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.817200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.817482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.818184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.820472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bd339-baa4-47b9-877a-726bd2e936a0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.846432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 796/1608] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:29.846432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c5a1-4f86-4dda-8d53-ef4512b4b7c7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.846432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c5a1-4f86-4dda-8d53-ef4512b4b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.846432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4c5a1-4f86-4dda-8d53-ef4512b4b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.877591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-54f4c5a1-4f86-4dda-8d53-ef4512b4b7c7 None None] MFA Rules not processed for user `99eceaf1a3984d189ace4ce96827867c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:29.879548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-54f4c5a1-4f86-4dda-8d53-ef4512b4b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.881866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05a118-aa08-4d7b-aee8-b5639a74f2a7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.888500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.889418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.889886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.890347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.956712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:29.958164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:29.965280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 797/1609] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:29.966360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17750-aa86-46e2-899b-8d11e3161da5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.966658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17750-aa86-46e2-899b-8d11e3161da5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.966943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b17750-aa86-46e2-899b-8d11e3161da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.969259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 813/1610] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:29.969922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:29.971291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.983016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e69b3-3520-429d-b5b5-e0bb4ec8035f service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:29.986600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-34b17750-aa86-46e2-899b-8d11e3161da5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:29.987505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:29.988070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-34b17750-aa86-46e2-899b-8d11e3161da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:29.988197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.988455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.988754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.996976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 798/1611] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:29.998443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc15b-93cd-43fb-9e4e-7041a42dfbab None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:29.998887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc15b-93cd-43fb-9e4e-7041a42dfbab None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:29.999003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dc15b-93cd-43fb-9e4e-7041a42dfbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:29.999960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.002331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db721-3f56-44e7-bf26-91de4ace8c8f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.014715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 814/1612] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:30.016160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.016455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.016737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.028453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d46dc15b-93cd-43fb-9e4e-7041a42dfbab None None] MFA Rules not processed for user `a59c374bad30460cae95b0f66729a618`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:30.029705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d46dc15b-93cd-43fb-9e4e-7041a42dfbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:30.050487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] MFA Rules not processed for user `2dcce9f3178344dba7ecaf751dd08713`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:30.054442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:30.120839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 799/1613] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:30.122504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0dd0e-a3be-4df5-8d76-f2fc99c6e878 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.122984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0dd0e-a3be-4df5-8d76-f2fc99c6e878 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.123320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0dd0e-a3be-4df5-8d76-f2fc99c6e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.135544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 815/1614] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:30.136540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.151772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-69c0dd0e-a3be-4df5-8d76-f2fc99c6e878 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:30.153702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-69c0dd0e-a3be-4df5-8d76-f2fc99c6e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:30.154785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3bcf8-e00c-42bd-acb9-c44737be1d3a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.164000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.164532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 800/1615] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:30.164884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.165989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.168123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.168123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.168627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdaae-c538-4ec3-ad44-09be78aff474 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.169170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdaae-c538-4ec3-ad44-09be78aff474 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.169785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbdaae-c538-4ec3-ad44-09be78aff474 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.172097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.172579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 801/1616] 10.222.0.60 () {54 vars in 961 bytes} [Tue May 10 17:44:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:30.173655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdaae-c538-4ec3-ad44-09be78aff474 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.188069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbdaae-c538-4ec3-ad44-09be78aff474 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.189107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 816/1617] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:30.190380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.192991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.193939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.194293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.194677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.202636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e763b-8ca7-47c8-b1e6-49ae3192be9c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.208218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.208389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.208983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.209316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.209612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.209870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.222396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.223224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 802/1618] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:30.224220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.227278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ca770-3fe1-441b-8826-a58229c550f3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.236908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87ada8-9431-471c-9e26-9191780cca2e service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.243953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.244794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.245124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.245449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.246301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.248320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.282961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 817/1619] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:30.283979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 803/1620] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:30.284872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.287665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.288650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.289069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.311781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:30.313004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:30.369567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ea81-bd42-4f68-bfe1-6d1e62e3d2eb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.374814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.375821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.376320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.376546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.418687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 818/1621] 10.222.0.60 () {58 vars in 1058 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:30.419810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.456182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.457814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.485635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 804/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:30.486506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.500800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0dcfe-ecb9-434e-8443-29584a29dfe0 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.507466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.508505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.509510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.509853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.510504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.512572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.517920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c7f86-41d1-47b8-aecc-bafec9acc6d1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.526779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.528435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.528435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.528435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] PATH_INFO: `/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.542099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 805/1623] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:30.542099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.547736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730167fdbbf94137a3d16cbeb4f9df6a, user_id=50b9aeb0ec4f4f1993c72f7bb95ac7f1, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.550645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.553632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce66551-c2e5-439c-baa2-90791d6d510d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.560904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.561680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.562118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.562527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.563681 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.565702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.581677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 819/1624] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:30 2022] PUT /identity/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:30.584015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.604906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 806/1625] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/users => generated 285 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:30.606031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.640018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cdab5-7c16-4c7e-8cd9-e5dd7a72900d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.706978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3fa6-f272-42ec-b03e-eec9b1aad004 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.716729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.717892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.718336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.718805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.728646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.730165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.730440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.730931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.732063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.733924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.750974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 807/1626] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:30.750974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.760677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ce48-b9c9-4e48-bce9-fc0fbf2a4197 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.766836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.767578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.767962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.768246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.769102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.770854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.790083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 808/1627] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:30.790914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.794810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.796926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.803076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3f10-e56d-45a9-abe3-3d270f97b3d9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.810533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.811393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.811606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.812036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.812903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.814830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.829150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 809/1628] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:30.830028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.838747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 820/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:30.839680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.842869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94efb83-84e5-4360-b8d0-a8aa31ab02bf admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.850530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.851490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.851787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.852070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] PATH_INFO: `/v3/projects/4dbd609025644fbab083e3b5afda6263/users/bb387edb3daa487eb996870657347f42/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.854709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81594e-b754-406b-a959-46c1fe11d4d7 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:30.870219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:30.871156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.871481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.871769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] PATH_INFO: `/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:30.875605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=730167fdbbf94137a3d16cbeb4f9df6a, user_id=50b9aeb0ec4f4f1993c72f7bb95ac7f1, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.883462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.892150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbd609025644fbab083e3b5afda6263, user_id=bb387edb3daa487eb996870657347f42, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:30.897756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711b1d3-55f6-4963-b51c-6d3da0eb2169 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:30.908135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 821/1630] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:30 2022] PUT /identity/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:30.909387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:30.935542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 810/1631] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:30 2022] PUT /identity/v3/projects/4dbd609025644fbab083e3b5afda6263/users/bb387edb3daa487eb996870657347f42/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:30.940830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:30.941156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:30.941410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.011408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] MFA Rules not processed for user `50b9aeb0ec4f4f1993c72f7bb95ac7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:31.019685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:31.112667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75588c9-df8d-4aa4-bfd8-350bcdc554ce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:31.224572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 811/1632] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:31.227041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:31.253300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:31.257265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.258091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.258735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] PATH_INFO: `/v3/projects/f10a9c8167384c409fd263e1d9e89b47/users/bd7dfa2ed50540e5bab6abd2b04441dd/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.292996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10a9c8167384c409fd263e1d9e89b47, user_id=bd7dfa2ed50540e5bab6abd2b04441dd, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:31.295984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e70227-e1db-4490-8594-81b50c1f2388 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:31.317645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 822/1633] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:30 2022] PUT /identity/v3/projects/f10a9c8167384c409fd263e1d9e89b47/users/bd7dfa2ed50540e5bab6abd2b04441dd/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:31.319404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.319404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.319663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.376894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] MFA Rules not processed for user `ca6c3d8d36db4f5fbc6c24834f81f599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:31.378163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:31.400850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50196b-6f7d-4cb2-9d03-f89eebbc69ed None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:31.526390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 823/1634] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:31.527988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:31.531602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:31.532392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.532682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.532961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.533709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:31.538789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117eb0ce-097b-4957-8554-38544c0d61d2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:31.565574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 812/1635] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:31.570660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749006-99a6-418d-a07e-026abde10ec4 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.570975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749006-99a6-418d-a07e-026abde10ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.572428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749006-99a6-418d-a07e-026abde10ec4 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.575589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 813/1636] 10.222.0.60 () {54 vars in 912 bytes} [Tue May 10 17:44:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:31.578500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749006-99a6-418d-a07e-026abde10ec4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:31.606063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749006-99a6-418d-a07e-026abde10ec4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:31.612736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242c12-2d01-40bc-bf43-735930894bf8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:31.618454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:31.619167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.620427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:31.620610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.620916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.621183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.621480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.621806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.623040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:31.627560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983a645-07ea-48f5-a758-87f30f90e079 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:31.653759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 814/1637] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:31.655632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178e60-f48b-42f0-b242-941639cf803b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.656004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178e60-f48b-42f0-b242-941639cf803b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.656447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178e60-f48b-42f0-b242-941639cf803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.700308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5c178e60-f48b-42f0-b242-941639cf803b None None] MFA Rules not processed for user `ca6c3d8d36db4f5fbc6c24834f81f599`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:31.701626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5c178e60-f48b-42f0-b242-941639cf803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:31.704745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:31.706664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:31.722870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 824/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:31.723886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:31.740482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 815/1639] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:31.741790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44943da3-4617-4e22-8522-f3b9b8ef8be9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.742088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44943da3-4617-4e22-8522-f3b9b8ef8be9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.742373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44943da3-4617-4e22-8522-f3b9b8ef8be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.767842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8590-224f-4a01-b478-24e891168a46 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:31.774670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:31.777550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:31.779872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:31.780176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] PATH_INFO: `/v3/projects/4dbd609025644fbab083e3b5afda6263/users/bb387edb3daa487eb996870657347f42/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:31.785597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbd609025644fbab083e3b5afda6263, user_id=bb387edb3daa487eb996870657347f42, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:31.791329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:31.795251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-44943da3-4617-4e22-8522-f3b9b8ef8be9 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:31.800149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-44943da3-4617-4e22-8522-f3b9b8ef8be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:31.830874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 825/1640] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:31 2022] PUT /identity/v3/projects/4dbd609025644fbab083e3b5afda6263/users/bb387edb3daa487eb996870657347f42/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:31.836649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:31.991633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e8c9-8ac3-4b17-9ac1-88a05ce49e17 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:32.004563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:32.005482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.005767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.006049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] PATH_INFO: `/v3/projects/f10a9c8167384c409fd263e1d9e89b47/users/bd7dfa2ed50540e5bab6abd2b04441dd/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.010285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10a9c8167384c409fd263e1d9e89b47, user_id=bd7dfa2ed50540e5bab6abd2b04441dd, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:32.012943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee6af-2db4-4b55-a5d7-7e79f71ea6ec admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:32.019637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 816/1641] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:44:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:32.026739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe11a3-f88e-4dab-b6f0-c46c8a149327 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.028785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe11a3-f88e-4dab-b6f0-c46c8a149327 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.030677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe11a3-f88e-4dab-b6f0-c46c8a149327 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.035311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 817/1642] 10.222.0.60 () {54 vars in 961 bytes} [Tue May 10 17:44:32 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:32.037763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.037966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.038201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.051299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 826/1643] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:31 2022] PUT /identity/v3/projects/f10a9c8167384c409fd263e1d9e89b47/users/bd7dfa2ed50540e5bab6abd2b04441dd/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:32.052898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e702fc-3335-4435-978c-e47b29fe8ad9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.053199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e702fc-3335-4435-978c-e47b29fe8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.053479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e702fc-3335-4435-978c-e47b29fe8ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.104965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] MFA Rules not processed for user `bb387edb3daa487eb996870657347f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:32.106151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:32.108376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-59e702fc-3335-4435-978c-e47b29fe8ad9 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:32.109673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-59e702fc-3335-4435-978c-e47b29fe8ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:32.234877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 818/1644] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:32.241488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:32.319980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d411a-6a03-4a1f-bb43-6607fab4a896 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:32.325334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:32.326068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.326532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.326978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.327976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 827/1645] 10.222.0.60 () {58 vars in 1058 bytes} [Tue May 10 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:32.333305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1d7b-dc45-44e3-8b74-b39bb4608581 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.333555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1d7b-dc45-44e3-8b74-b39bb4608581 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.333820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1d7b-dc45-44e3-8b74-b39bb4608581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.340283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:32.341768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:32.356089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 819/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:32.357199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:32.378872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83c72-d35d-4a5d-a5f5-0950ae19d6a9 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:32.386195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:32.387199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.387809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.390012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.417057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:32.419182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:32.431515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 820/1647] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:32.432654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:32.443768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0c6e1d7b-dc45-44e3-8b74-b39bb4608581 None None] MFA Rules not processed for user `bd7dfa2ed50540e5bab6abd2b04441dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:32.446712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0c6e1d7b-dc45-44e3-8b74-b39bb4608581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:32.447232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e261-3d3b-4b37-a101-85366ff3af1b service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:32.454359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:32.455032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.455318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.455862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.585107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:32.589947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:32.616918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 821/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:32.639159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 828/1649] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:32 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:32.788114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:32.802533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcccdfa-3a83-4ba7-b64e-a144f17c3c6a service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:32.825050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:32.827397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:32.827888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:32.828494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:32.853943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:32.855716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd898228-6911-40f5-81a0-93530bca86dc service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:32.885325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 822/1650] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:32 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:33.207942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:33.207942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:33.207942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:33.207942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 829/1651] 10.222.0.60 () {54 vars in 912 bytes} [Tue May 10 17:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:33.227494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:33.227712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:33.227998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:33.268232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:33.269665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:33.318030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 823/1652] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:44:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:33.337458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:33.339689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:33.512263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187b0f3-d58a-4587-91e0-fb0d00349b9f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:33.526534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:33.527231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:33.527632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:33.527916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:33.556031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:33.560996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:33.566528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:33.578804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c4131-f884-4783-afc2-9dc341b41441 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:33.594321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:33.595460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:33.595460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:33.595775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:33.601788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 830/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:33.853077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:33.854566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2f49-2e9a-4098-99f8-8fbadaeed7c2 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:33.877849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 824/1654] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:33 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:34.478696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:34.701671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2a763-95f9-44a6-9416-1488ccda6d7a service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:34.726817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:34.729329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:34.731014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:34.731515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] PATH_INFO: `/v3/users/4798885b96e246598c277df29198a0d2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:34.734447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4798885b96e246598c277df29198a0d2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:34.735913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: WARNING py.warnings [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:34.735913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: warnings.warn(msg) May 10 17:44:34.735913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: May 10 17:44:34.737748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:34.744068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72f71-6266-459d-880d-46701895dd19 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:34.744630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72f71-6266-459d-880d-46701895dd19 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:34.744630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72f71-6266-459d-880d-46701895dd19 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:34.748841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 825/1655] 10.222.0.60 () {54 vars in 912 bytes} [Tue May 10 17:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:44:34.754661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c973-44c1-455f-8feb-f025324d3e6b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:34.755148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c973-44c1-455f-8feb-f025324d3e6b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:34.755682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c973-44c1-455f-8feb-f025324d3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:34.869881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-58f3c973-44c1-455f-8feb-f025324d3e6b None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:34.871242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58f3c973-44c1-455f-8feb-f025324d3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:34.897109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4798885b96e246598c277df29198a0d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:34.911807 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4798885b96e246598c277df29198a0d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:34.960660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4798885b96e246598c277df29198a0d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:34.964969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4798885b96e246598c277df29198a0d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:34.965477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4798885b96e246598c277df29198a0d2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:35.008741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 826/1656] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:44:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:44:35.008965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 831/1657] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:34 2022] DELETE /identity/v3/users/4798885b96e246598c277df29198a0d2 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:35.010817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:35.011122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:35.017428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:35.088515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:35.091680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:35.099404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:35.101578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:35.271207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51d1f4-ecbc-40e4-8497-abc03032abcd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:35.281022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:35.283972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:35.284400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:35.284694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:35.299398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 827/1658] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:35.304094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:35.306848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e17911-c2b3-4166-9eda-d88e89645419 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:35.316865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 832/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:44:35.331035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:35.357380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a6a5-32ed-4ed4-b532-fbe325868c60 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:35.361321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:35.361988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:35.362274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:35.362554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:35.396785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:35.402116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4fd0a-d930-44a6-82e5-26a365f30144 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:35.441490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 828/1660] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:36.539541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eea5f-ce9b-4458-b0cd-342be883a5dd None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:36.540564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eea5f-ce9b-4458-b0cd-342be883a5dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:36.540983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97eea5f-ce9b-4458-b0cd-342be883a5dd None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:36.543145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 833/1661] 10.222.0.60 () {54 vars in 960 bytes} [Tue May 10 17:44:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:36.548679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:36.549496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:36.549908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:36.585148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] MFA Rules not processed for user `228acc1362ed42cc82e3f5ddc0467ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:36.589278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:36.773496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eea5f-ce9b-4458-b0cd-342be883a5dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:36.779595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 829/1662] 10.222.0.60 () {58 vars in 1057 bytes} [Tue May 10 17:44:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:36.802791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97eea5f-ce9b-4458-b0cd-342be883a5dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:36.829328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:36.830022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:36.830302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:36.830579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:36.846918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:36.880109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:36.882123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:36.922563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 834/1663] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:44:37.414630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:37.416481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:37.444555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbfaa0-80fb-4854-a8aa-102cc708080e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:37.458804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:37.460272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:37.460704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:37.461194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] PATH_INFO: `/v3/users/a59c374bad30460cae95b0f66729a618` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:37.465834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59c374bad30460cae95b0f66729a618)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:37.471249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:37.602910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59c374bad30460cae95b0f66729a618'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.607872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59c374bad30460cae95b0f66729a618'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.622176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:37.623723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:37.656027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9655c-f0bf-4c08-a783-e44d0a9167c1 service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:37.658734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59c374bad30460cae95b0f66729a618'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.661989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59c374bad30460cae95b0f66729a618'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.682092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:37.684117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dcb2e542-5054-442d-9aa4-ac223c6781b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59c374bad30460cae95b0f66729a618'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.685787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:37.687674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:37.692604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] PATH_INFO: `/v3/projects/f790b6e8a65a4f73867f613cc95b589d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:37.698835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f790b6e8a65a4f73867f613cc95b589d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:37.706498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:37.707635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 830/1664] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:37 2022] DELETE /identity/v3/users/a59c374bad30460cae95b0f66729a618 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:37.714887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:37.715443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:37.716007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:37.759257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:37.761462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:37.839186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f790b6e8a65a4f73867f613cc95b589d', 'request_id': 'req-313fd922-a3c5-4d72-a32d-a9fd8848fffe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.864544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f790b6e8a65a4f73867f613cc95b589d', 'request_id': 'req-313fd922-a3c5-4d72-a32d-a9fd8848fffe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.864803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 831/1665] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:37.889099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f790b6e8a65a4f73867f613cc95b589d', 'request_id': 'req-313fd922-a3c5-4d72-a32d-a9fd8848fffe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.914295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:37.916649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:37.932811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] The token cache is being invalidate because project f790b6e8a65a4f73867f613cc95b589d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:37.933098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.934717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:37.941612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 835/1666] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:37 2022] DELETE /identity/v3/projects/f790b6e8a65a4f73867f613cc95b589d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:37.945831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:37.952875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:38.112998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37902f-89df-42f4-82ca-7a3d5219bc6e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:38.186767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd922-a3c5-4d72-a32d-a9fd8848fffe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:38.204998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:38.205933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:38.206221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:38.206508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] PATH_INFO: `/v3/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:38.208136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b9aeb0ec4f4f1993c72f7bb95ac7f1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:38.210171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:38.270978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:38.271884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:38.272322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:38.272718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:38.276887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:38.311417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b9aeb0ec4f4f1993c72f7bb95ac7f1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:38.314548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:38.316176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:38.331338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b9aeb0ec4f4f1993c72f7bb95ac7f1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:38.345568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 832/1667] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:38.365012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b9aeb0ec4f4f1993c72f7bb95ac7f1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:38.368321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b9aeb0ec4f4f1993c72f7bb95ac7f1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:38.371874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b9aeb0ec4f4f1993c72f7bb95ac7f1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:38.399899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 836/1668] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:37 2022] DELETE /identity/v3/users/50b9aeb0ec4f4f1993c72f7bb95ac7f1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:39.608351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:39.629955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7a3b-8eb7-4c55-8e7f-00036ea9f95b service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:39.850701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:39.851979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:39.852974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:39.853426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] PATH_INFO: `/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:39.855685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730167fdbbf94137a3d16cbeb4f9df6a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:39.856905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: WARNING py.warnings [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 17:44:39.856905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: warnings.warn(msg) May 10 17:44:39.856905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: May 10 17:44:39.858527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:39.986779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:39.991656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:40.004766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730167fdbbf94137a3d16cbeb4f9df6a', 'request_id': 'req-b4aa23ae-411d-4691-85c7-cc5d91085fd8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.021224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730167fdbbf94137a3d16cbeb4f9df6a', 'request_id': 'req-b4aa23ae-411d-4691-85c7-cc5d91085fd8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.030553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85a3ff-bb9d-4a41-ba69-6e45fea7cf1c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:40.053283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730167fdbbf94137a3d16cbeb4f9df6a', 'request_id': 'req-b4aa23ae-411d-4691-85c7-cc5d91085fd8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.079134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] The token cache is being invalidate because project 730167fdbbf94137a3d16cbeb4f9df6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:40.079463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.080557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b4aa23ae-411d-4691-85c7-cc5d91085fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.084869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 833/1669] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:39 2022] DELETE /identity/v3/projects/730167fdbbf94137a3d16cbeb4f9df6a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:40.090382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0233-93f6-4fa5-9a99-3896eba8322d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.090763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0233-93f6-4fa5-9a99-3896eba8322d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.091148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0233-93f6-4fa5-9a99-3896eba8322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.129006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-957f0233-93f6-4fa5-9a99-3896eba8322d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:40.130541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-957f0233-93f6-4fa5-9a99-3896eba8322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:40.147795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:40.149963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.150408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.150822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] PATH_INFO: `/v3/projects/d14ee6e6a46c4220a3653c732ca222d7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.152643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14ee6e6a46c4220a3653c732ca222d7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:40.154784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:40.227494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14ee6e6a46c4220a3653c732ca222d7', 'request_id': 'req-7bc2de2b-e38c-4902-b4ba-e669d9bee776'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.236168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14ee6e6a46c4220a3653c732ca222d7', 'request_id': 'req-7bc2de2b-e38c-4902-b4ba-e669d9bee776'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.250755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14ee6e6a46c4220a3653c732ca222d7', 'request_id': 'req-7bc2de2b-e38c-4902-b4ba-e669d9bee776'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.276988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] The token cache is being invalidate because project d14ee6e6a46c4220a3653c732ca222d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:40.277578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.280050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.285007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 837/1670] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:39 2022] DELETE /identity/v3/projects/d14ee6e6a46c4220a3653c732ca222d7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:40.289747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:40.291254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:40.333939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 834/1671] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:40.342413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.342822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.343222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.388253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:40.393101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:40.541062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2de2b-e38c-4902-b4ba-e669d9bee776 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:40.553728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:40.556226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.556567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.556870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] PATH_INFO: `/v3/users/bb387edb3daa487eb996870657347f42` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.558568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb387edb3daa487eb996870657347f42)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:40.561132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 835/1672] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:44:40.562362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:40.564788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:40.586032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b41ba-519f-47f1-8945-30e37fc04f2c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:40.597404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:40.598927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.600508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.600982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.603197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:40.606914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:40.612263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:40.652186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 836/1673] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:40.656617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:40.684955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e532-d6bf-41e8-b9a4-29562d04ad8e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:40.699867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:40.701854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.705653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.706109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.707003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:40.709270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:40.783180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 837/1674] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:40 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:40.787246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:40.886794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb387edb3daa487eb996870657347f42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.903113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb387edb3daa487eb996870657347f42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.958005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb387edb3daa487eb996870657347f42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.960728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb387edb3daa487eb996870657347f42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.962453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb387edb3daa487eb996870657347f42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:40.979536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038875d-408b-4011-a57b-fcead763b4c3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:40.990301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:40.997154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 838/1675] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:40 2022] DELETE /identity/v3/users/bb387edb3daa487eb996870657347f42 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:40.997731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:40.997731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:40.997731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:40.997731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:40.999728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:41.041101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 838/1676] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:40 2022] POST /identity/v3/users => generated 295 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:41.046449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:41.048076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:41.178164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17787e97-b7b5-47e8-b69a-b87b60a8b1ac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:41.210776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:41.212290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:41.212897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:41.216203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:41.218165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:41.224820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:41.260378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 839/1677] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:41.261016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:41.275701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce855-cdaf-455d-b85e-5df012085bf7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:41.286510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:41.287199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:41.288259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:41.288431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:41.289196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:41.293481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4a4e5-1c41-4431-932e-fe125a2c0b29 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:41.330732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 839/1678] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:44:41.335220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:41.355439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22976ff1-c60b-4094-be5a-6ac09c059d49 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:41.370406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:41.372725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:41.373788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:41.374857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] PATH_INFO: `/v3/projects/7a96cd89b08e415182f00d6548cf2b35/users/ccf30b0ab85f4ebea7b8c72191ebce1b/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:41.413568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a96cd89b08e415182f00d6548cf2b35, user_id=ccf30b0ab85f4ebea7b8c72191ebce1b, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:41.416535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:41.446417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 840/1679] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:41 2022] PUT /identity/v3/projects/7a96cd89b08e415182f00d6548cf2b35/users/ccf30b0ab85f4ebea7b8c72191ebce1b/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:41.457273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:41.457600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:41.457905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:41.511905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] MFA Rules not processed for user `ccf30b0ab85f4ebea7b8c72191ebce1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:41.514401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:41.671659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 840/1680] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:41.676830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:41.815130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c97452-9182-4e31-82cc-01e601cd26f5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:41.822038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:41.823058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:41.823657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:41.824305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:41.825309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:41.827937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:41.926902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 841/1681] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:41 2022] POST /identity/v3/projects => generated 389 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:44:41.927151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:41.944726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d36fc-4df7-443f-9465-defd3ced6fc1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.106009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.106781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.107079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.107389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.108111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.115234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.159117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 841/1682] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:41 2022] POST /identity/v3/users => generated 301 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:42.162892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:42.189158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555eb2-21d8-4aed-bf84-a32f93813760 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.207887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.211989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.212727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.213154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.214073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.220784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.245516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 842/1683] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:42.246052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:42.261012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c6ad-dc61-45b3-99d6-85f90487e5c5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.278344 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.279272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.279590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.280039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] PATH_INFO: `/v3/projects/3de342438b854841a480f1c6577fb081/users/a1d44b9c330942388cd639e0500d28a6/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.320261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de342438b854841a480f1c6577fb081, user_id=a1d44b9c330942388cd639e0500d28a6, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.323889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.355776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 842/1684] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:42 2022] PUT /identity/v3/projects/3de342438b854841a480f1c6577fb081/users/a1d44b9c330942388cd639e0500d28a6/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:42.359800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:42.374973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a2412-fac0-4dd2-a107-871b694dfc0c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.474271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.475013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.475305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.475627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.477811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.480287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbba64a-236d-431a-9388-f741023ae66f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.501167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 843/1685] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:42.501355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:42.516452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715a78-6f04-4806-b599-2869157852ba admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.529290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.530370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.530704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.531230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] PATH_INFO: `/v3/projects/3de342438b854841a480f1c6577fb081/users/a1d44b9c330942388cd639e0500d28a6/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.538091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de342438b854841a480f1c6577fb081, user_id=a1d44b9c330942388cd639e0500d28a6, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.544008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.573175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 843/1686] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:42 2022] PUT /identity/v3/projects/3de342438b854841a480f1c6577fb081/users/a1d44b9c330942388cd639e0500d28a6/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:42.575799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.576419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.576993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.616767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] MFA Rules not processed for user `a1d44b9c330942388cd639e0500d28a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:42.618894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:42.803022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:42.806270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:42.808656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 844/1687] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:42.893220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d055034-f2a6-45d8-9a7e-a5502cd66141 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:42.906847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:42.908506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:42.909056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:42.909469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:42.927479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:42.930038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:42.952119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 844/1688] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:43.330433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:43.682021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c5c3-783e-4090-925a-986b96caebb8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:43.717460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:43.730421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:43.730897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:43.731383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] PATH_INFO: `/v3/users/ccf30b0ab85f4ebea7b8c72191ebce1b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:43.735872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf30b0ab85f4ebea7b8c72191ebce1b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:43.739450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:43.926361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf30b0ab85f4ebea7b8c72191ebce1b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:43.941606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf30b0ab85f4ebea7b8c72191ebce1b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:43.968887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:43.969424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf30b0ab85f4ebea7b8c72191ebce1b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:43.970968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf30b0ab85f4ebea7b8c72191ebce1b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:43.973059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a7461cb-fdc5-4251-9cf8-80fb2c8083de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf30b0ab85f4ebea7b8c72191ebce1b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:43.975229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.015304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 845/1689] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:43 2022] DELETE /identity/v3/users/ccf30b0ab85f4ebea7b8c72191ebce1b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:44.015935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39acac-a82d-40f3-99c8-6384933489ee None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.016235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39acac-a82d-40f3-99c8-6384933489ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.016537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39acac-a82d-40f3-99c8-6384933489ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.039896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a160a2-6647-4e35-8669-e57fc4ae9a28 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:44.104321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cb39acac-a82d-40f3-99c8-6384933489ee None None] MFA Rules not processed for user `ed37128b78a6454c9c387ad91995a05d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:44.105605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cb39acac-a82d-40f3-99c8-6384933489ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.281225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:44.282387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.283024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.283516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] PATH_INFO: `/v3/projects/4dbd609025644fbab083e3b5afda6263` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.288817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbd609025644fbab083e3b5afda6263)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:44.293602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:44.368139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 846/1690] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:44.370111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.370639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.371551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.420777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:44.432903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.483705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbd609025644fbab083e3b5afda6263', 'request_id': 'req-9ba87762-5bc1-47eb-9191-a720d9463192'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:44.515792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbd609025644fbab083e3b5afda6263', 'request_id': 'req-9ba87762-5bc1-47eb-9191-a720d9463192'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:44.549974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbd609025644fbab083e3b5afda6263', 'request_id': 'req-9ba87762-5bc1-47eb-9191-a720d9463192'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:44.594255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] The token cache is being invalidate because project 4dbd609025644fbab083e3b5afda6263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:44.594574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:44.595967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9ba87762-5bc1-47eb-9191-a720d9463192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:44.606506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 845/1691] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:43 2022] DELETE /identity/v3/projects/4dbd609025644fbab083e3b5afda6263 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:44.610863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faac40-df39-4708-9793-6996d8b1a334 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.611178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faac40-df39-4708-9793-6996d8b1a334 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.612363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faac40-df39-4708-9793-6996d8b1a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.673284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 847/1692] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:44.674465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:44.678815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-16faac40-df39-4708-9793-6996d8b1a334 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:44.683891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-16faac40-df39-4708-9793-6996d8b1a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.684358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.860277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 846/1693] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:44:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:44.860277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.860277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.860277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.896713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:44.898088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.919189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 847/1694] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:44.920291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:44.922223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:44.936497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e59367-52bc-40c1-911d-b5564d8f5d26 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:44.968959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:44.969695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:44.969984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:44.970260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:44.975676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:45.086030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6181e9-a228-49af-905c-102bd0f94749 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.103841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.104567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.104856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.107601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.148533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.153603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64762671-25b7-4905-9791-7f74f2cfc875 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.177907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.179658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.189914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 848/1695] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:45.191286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.191608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.191893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.192478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 848/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:45.256904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.259003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:45.282384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:45.282384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:45.306654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 849/1697] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:45.308006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.333935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440cd8-ac8b-4f1d-950b-f2f2d7f2aada None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.339710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.340670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.341042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.341624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.342491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:45.342876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.346538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.384795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 850/1698] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:45.385865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.406398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e92d5-0072-4e2c-917a-7921cce19f43 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.412992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.414302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.415510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.416256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.417097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.420825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.458060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d9a1-d81f-4d8e-a1aa-2e0bdfef34d4 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.472215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.473346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.475814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.476344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.484198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 851/1699] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:45 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:45.486257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.499109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.501419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.527737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 849/1700] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:44:45.632764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdda48-efa7-4077-a3ee-7cd2e9c134ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.639333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.640477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.641176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.641509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.642605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.645644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.682001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.683329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 852/1701] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:45 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:45.694590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b60f9-0141-434d-948f-1a2c105e66e5 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.701602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.702601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.703094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.703698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.704880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.706736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.722765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 850/1702] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:45.729017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.762285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257cf0-df1a-4ce2-810e-f03b90768d53 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.774759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.775670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.775963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.776254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.777249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.780026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16f04e-df18-467c-b7a0-935c26da1f0a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.806763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:45.806969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 853/1703] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:45.827886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e5d11-3877-4a34-bfeb-3493e976f650 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:45.846752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:45.847968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.851706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.852736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] PATH_INFO: `/v3/projects/672b029a611d4f52bad4de84d93570da/users/a7b64f71d6d445c98ef5bb8b5870acb4/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.927247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=672b029a611d4f52bad4de84d93570da, user_id=a7b64f71d6d445c98ef5bb8b5870acb4, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:45.930306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85265a2b-d4ee-402b-87bb-719cc6243feb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:45.939221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.939577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.939866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:45.985084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 851/1704] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:45 2022] PUT /identity/v3/projects/672b029a611d4f52bad4de84d93570da/users/a7b64f71d6d445c98ef5bb8b5870acb4/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:45.999157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f51a3-7128-49f5-9052-84b72ffb5ad7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:45.999486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f51a3-7128-49f5-9052-84b72ffb5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:45.999771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f51a3-7128-49f5-9052-84b72ffb5ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:46.043492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] MFA Rules not processed for user `93f2755bf7ac430f9380bf2cf3ecb97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:46.044973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:46.087295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-819f51a3-7128-49f5-9052-84b72ffb5ad7 None None] MFA Rules not processed for user `a7b64f71d6d445c98ef5bb8b5870acb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:46.088623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-819f51a3-7128-49f5-9052-84b72ffb5ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:46.301246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 854/1705] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:46.302225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:46.306697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:46.316667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 852/1706] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:46.322063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:46.322456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:46.323588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:46.369513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] MFA Rules not processed for user `93f2755bf7ac430f9380bf2cf3ecb97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:46.371143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:46.385301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 853/1707] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:44:46.388051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:46.549671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189eaaa-acb2-494e-9024-10fcd7e2eced None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:46.563800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:46.564736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:46.565029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:46.565305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] PATH_INFO: `/v3/users/99eceaf1a3984d189ace4ce96827867c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:46.574421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=99eceaf1a3984d189ace4ce96827867c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:46.577942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:46.627023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7dd9a-1ef9-4f6b-9541-bdaa7e360512 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:46.649988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:46.650789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:46.651290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:46.651826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:46.653905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:46.661460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:46.705193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99eceaf1a3984d189ace4ce96827867c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:46.707938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99eceaf1a3984d189ace4ce96827867c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:46.746371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 854/1708] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:46 2022] POST /identity/v3/projects => generated 381 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:46.747238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:46.748116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99eceaf1a3984d189ace4ce96827867c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:46.750163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99eceaf1a3984d189ace4ce96827867c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:46.761825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ace56e63-e7db-4d01-bd47-133d6583d3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99eceaf1a3984d189ace4ce96827867c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:46.762671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:46.820855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 855/1709] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:46 2022] DELETE /identity/v3/users/99eceaf1a3984d189ace4ce96827867c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:46.824355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:46.833579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:46.834914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:46.946064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] MFA Rules not processed for user `e6a99e5d684a48a2845d3379e7df812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:46.947526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.082733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa60e1-6d7c-4556-843c-a2e2258b38b8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:47.193722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 856/1710] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:47.194718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:47.202854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.294763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:47.295381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:47.299196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:47.299762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:47.302448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.460767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e1232-c704-4e1e-9294-58ca6a21aac5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:47.475278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:47.476052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:47.479529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:47.482642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:47.484038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:47.486805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eed621-e503-4767-8ed6-afc70bb6e2ee admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:47.496223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:47.498161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:47.552148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 857/1711] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:47 2022] POST /identity/v3/users => generated 297 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:47.552372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 855/1712] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:47.552462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:47.552462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:47.552595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:47.552770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:47.554494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.615236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff9ea-3a75-45ca-8be8-e80274e874ba service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:47.616529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:47.621042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.641727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:47.643194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:47.646055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:47.646567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] PATH_INFO: `/v3/projects/7a96cd89b08e415182f00d6548cf2b35` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:47.652382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a96cd89b08e415182f00d6548cf2b35)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:47.658513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:47.659181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 858/1713] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:47.674197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:47.677799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.728120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216342a8-6021-4587-ac90-e4e5e6680cdb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:47.746426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:47.747103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:47.747416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:47.751136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:47.778592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a96cd89b08e415182f00d6548cf2b35', 'request_id': 'req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:47.790639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a96cd89b08e415182f00d6548cf2b35', 'request_id': 'req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:47.792120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:47.793983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:47.802794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a96cd89b08e415182f00d6548cf2b35', 'request_id': 'req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:47.825914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] The token cache is being invalidate because project 7a96cd89b08e415182f00d6548cf2b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:47.826223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:47.827437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:47.830780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 856/1714] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:47 2022] DELETE /identity/v3/projects/7a96cd89b08e415182f00d6548cf2b35 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:47.831795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:47.832385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 859/1715] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:47.833186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.837169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:47.844884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:47.987604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992d2d-7d6e-4978-b42e-f22b5fa4ed9a service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:47.997211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a0d05-eab4-4389-8e36-ae2aab5b6ecb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:48.003962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.005701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.006038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.006332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.007261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.011517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.030597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 857/1716] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:48.030597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:48.030987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.050293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981144d8-ed1a-4ecc-ab6a-9a2632474f1e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:48.060893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.062520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.062520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.062892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] PATH_INFO: `/v3/users/a1d44b9c330942388cd639e0500d28a6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.065128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d44b9c330942388cd639e0500d28a6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.069337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.105229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.106054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.106458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.106973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.113111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.152311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.157004 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.177728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d44b9c330942388cd639e0500d28a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:48.181357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 860/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:48.184487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:48.199233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d44b9c330942388cd639e0500d28a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:48.208940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e091715-9203-43ba-b74e-22e8957c42b5 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:48.223003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.224140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.224545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.224929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] PATH_INFO: `/v3/projects/512b65a94464429f97f2dffbe803750c/users/0e5e057889b741d587a70ed7b91bd4b7/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.237030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d44b9c330942388cd639e0500d28a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:48.239170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d44b9c330942388cd639e0500d28a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:48.241164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17a58f3b-ed1a-48b9-97ea-ae6517061c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d44b9c330942388cd639e0500d28a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:48.284537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512b65a94464429f97f2dffbe803750c, user_id=0e5e057889b741d587a70ed7b91bd4b7, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.287857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 858/1718] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:48 2022] DELETE /identity/v3/users/a1d44b9c330942388cd639e0500d28a6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:48.295490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257ca9-81e9-43bd-9ff5-6e0da46589aa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.296190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257ca9-81e9-43bd-9ff5-6e0da46589aa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.297810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257ca9-81e9-43bd-9ff5-6e0da46589aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.298325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.359921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 861/1719] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:48 2022] PUT /identity/v3/projects/512b65a94464429f97f2dffbe803750c/users/0e5e057889b741d587a70ed7b91bd4b7/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:48.360183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1b257ca9-81e9-43bd-9ff5-6e0da46589aa None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:48.361872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1b257ca9-81e9-43bd-9ff5-6e0da46589aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.376474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:48.382824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.602695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 859/1720] 10.222.0.77 () {58 vars in 1015 bytes} [Tue May 10 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:48.604857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082753da-6834-4d54-9167-aa30e9491c61 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:48.611530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.612260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.612710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.613232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.614102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.616059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.636616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab148-ab2d-48f8-9ce1-e6eddd14f43a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.636823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab148-ab2d-48f8-9ce1-e6eddd14f43a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.637178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdab148-ab2d-48f8-9ce1-e6eddd14f43a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.645171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 860/1721] 10.222.0.60 () {54 vars in 912 bytes} [Tue May 10 17:44:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:48.654605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9418-92bf-4034-b991-6e7b963df629 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.654793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9418-92bf-4034-b991-6e7b963df629 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.655080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f9418-92bf-4034-b991-6e7b963df629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.655991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 862/1722] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:48.656754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:48.670414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bbd57-05bb-44cd-831c-015f24d51189 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:48.687172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:48.688173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.688554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.688826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] PATH_INFO: `/v3/projects/512b65a94464429f97f2dffbe803750c/users/0e5e057889b741d587a70ed7b91bd4b7/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.698025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=512b65a94464429f97f2dffbe803750c, user_id=0e5e057889b741d587a70ed7b91bd4b7, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:48.700812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:48.708759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b16f9418-92bf-4034-b991-6e7b963df629 None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:48.710674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b16f9418-92bf-4034-b991-6e7b963df629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.754010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 863/1723] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:48 2022] PUT /identity/v3/projects/512b65a94464429f97f2dffbe803750c/users/0e5e057889b741d587a70ed7b91bd4b7/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:48.772225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:48.777010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:48.855676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 861/1724] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:48.861034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:48.861539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:48.862053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:48.914876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] MFA Rules not processed for user `0e5e057889b741d587a70ed7b91bd4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:48.916633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:49.038974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c2b7-718a-487b-babf-2ed20209cccf admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:49.049018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:49.050040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:49.051991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:49.052389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:49.067791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:49.070737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:49.082111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 862/1725] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:49.089780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 864/1726] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:49.094089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:49.095924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:49.356576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee9e9d-959c-4a02-af32-b518dc6ff388 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:49.378479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:49.379171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:49.379486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:49.379769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:49.384573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:49.386435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:49.418497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cadd-cad7-48a7-ad36-1ed3e2b860ab service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:49.422308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:49.422308 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:49.423510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:49.425543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:49.426024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:49.426270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:49.443676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:49.447000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:49.459492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 865/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:49.475459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 863/1728] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:44:50.261605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:50.319556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4b9e8-7b8b-4673-a4f2-487e1ca4d608 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:50.367163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5e057889b741d587a70ed7b91bd4b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '512b65a94464429f97f2dffbe803750c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:50.375904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:50.378121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:50.378529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:50.379500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:50.386708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:50.403630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:50.471711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:50.479497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 866/1729] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:50.486162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a6713-d2bc-4973-8dda-530d3f10bcef service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:50.519883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5e057889b741d587a70ed7b91bd4b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '512b65a94464429f97f2dffbe803750c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:50.520523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:50.520814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:50.521097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:50.521800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:50.524051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:50.655570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 864/1730] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:50 2022] POST /identity/v3/projects => generated 355 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:44:50.656714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:50.686982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efa2b6-032a-4869-83c1-1324e4ed9721 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:50.942422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5e057889b741d587a70ed7b91bd4b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '512b65a94464429f97f2dffbe803750c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:50.943467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:50.943923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:50.944367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:50.945279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:50.947838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:50.951836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672973d-cd4a-40f7-a4ee-99e727d5bb54 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:50.983799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 867/1731] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:51.114713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:51.135222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82c10-790f-4006-bff3-ad7b3d55ad98 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:51.155849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5e057889b741d587a70ed7b91bd4b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '512b65a94464429f97f2dffbe803750c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:51.157018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:51.157018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:51.157307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] PATH_INFO: `/v3/projects/b5ded1bd060c4c8dbb2cd8c4ebe7aac5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:51.165041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5ded1bd060c4c8dbb2cd8c4ebe7aac5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:51.170046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:51.347223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ded1bd060c4c8dbb2cd8c4ebe7aac5', 'request_id': 'req-ac66cae7-4129-4adc-8d11-a85058935415'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:51.386470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ded1bd060c4c8dbb2cd8c4ebe7aac5', 'request_id': 'req-ac66cae7-4129-4adc-8d11-a85058935415'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:51.405441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ded1bd060c4c8dbb2cd8c4ebe7aac5', 'request_id': 'req-ac66cae7-4129-4adc-8d11-a85058935415'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:51.434568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] The token cache is being invalidate because project b5ded1bd060c4c8dbb2cd8c4ebe7aac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:51.434894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:51.438781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:51.448796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 865/1732] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:51 2022] DELETE /identity/v3/projects/b5ded1bd060c4c8dbb2cd8c4ebe7aac5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:51.949262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6aa8-9636-451a-91b1-b6b8df41b9c2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:51.950451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6aa8-9636-451a-91b1-b6b8df41b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:51.950892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf6aa8-9636-451a-91b1-b6b8df41b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:51.988795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-56bf6aa8-9636-451a-91b1-b6b8df41b9c2 None None] MFA Rules not processed for user `93f2755bf7ac430f9380bf2cf3ecb97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:51.992213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-56bf6aa8-9636-451a-91b1-b6b8df41b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:52.104844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:52.106875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:52.183496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:44:52.358716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66cae7-4129-4adc-8d11-a85058935415 tempest-VolumeQuotaClassesTest-1955031880 tempest-VolumeQuotaClassesTest-1955031880-project-admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:52.380417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:52.381261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:52.381597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:52.381876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] PATH_INFO: `/v3/users/a7b64f71d6d445c98ef5bb8b5870acb4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:52.384420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b64f71d6d445c98ef5bb8b5870acb4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:52.387623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:52.518355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b64f71d6d445c98ef5bb8b5870acb4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:52.535357 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b64f71d6d445c98ef5bb8b5870acb4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:52.609907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b64f71d6d445c98ef5bb8b5870acb4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:52.611790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b64f71d6d445c98ef5bb8b5870acb4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:52.613390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b64f71d6d445c98ef5bb8b5870acb4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:52.668874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 866/1734] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:52 2022] DELETE /identity/v3/users/a7b64f71d6d445c98ef5bb8b5870acb4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:44:52.675911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:52.676469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:52.676848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:52.779346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:52.786450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:53.112751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 869/1735] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:53.138482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:53.140877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:53.402645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5441-bf5a-4364-ac32-1b2c583d51f4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:53.432506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:53.438399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:53.438709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:53.440314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:53.506848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:53.518040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:53.561305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 867/1736] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:44:53.889745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:53.891477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:53.934776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec04a7-286e-431b-9781-fadc0e16b638 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:53.961409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:53.964834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:53.967694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:53.970100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] PATH_INFO: `/v3/projects/39a2edf9ed6b480a9863609f51689013` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:53.977044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a2edf9ed6b480a9863609f51689013)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:53.981531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:54.192462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a2edf9ed6b480a9863609f51689013', 'request_id': 'req-e4e56a17-3061-4a78-a825-0f3e072f13ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.205368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a2edf9ed6b480a9863609f51689013', 'request_id': 'req-e4e56a17-3061-4a78-a825-0f3e072f13ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.244292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a2edf9ed6b480a9863609f51689013', 'request_id': 'req-e4e56a17-3061-4a78-a825-0f3e072f13ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.323597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:54.327851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:54.330321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] The token cache is being invalidate because project 39a2edf9ed6b480a9863609f51689013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:54.331535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.332946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e4e56a17-3061-4a78-a825-0f3e072f13ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.338472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 870/1737] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:53 2022] DELETE /identity/v3/projects/39a2edf9ed6b480a9863609f51689013 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:54.345144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83487cd-4903-4665-9cb1-a9a2dd981cb1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:54.347011 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83487cd-4903-4665-9cb1-a9a2dd981cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:54.347465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83487cd-4903-4665-9cb1-a9a2dd981cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:54.360733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d96bc-31c4-46d4-8f36-cfa6d78d1676 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:54.423600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c83487cd-4903-4665-9cb1-a9a2dd981cb1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:54.428311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c83487cd-4903-4665-9cb1-a9a2dd981cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:54.497804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:54.501742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:54.502104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:54.502370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] PATH_INFO: `/v3/projects/3de342438b854841a480f1c6577fb081` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:54.525689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de342438b854841a480f1c6577fb081)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:54.550504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:54.631651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 871/1738] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:44:54.641775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:54.642200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:54.642603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:54.688194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de342438b854841a480f1c6577fb081', 'request_id': 'req-9a37c54e-466c-45e9-8bec-5c0726a36886'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.691422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:54.696711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:54.713617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de342438b854841a480f1c6577fb081', 'request_id': 'req-9a37c54e-466c-45e9-8bec-5c0726a36886'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.736272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de342438b854841a480f1c6577fb081', 'request_id': 'req-9a37c54e-466c-45e9-8bec-5c0726a36886'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.775089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] The token cache is being invalidate because project 3de342438b854841a480f1c6577fb081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:54.778362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.781437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a37c54e-466c-45e9-8bec-5c0726a36886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:54.790892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 868/1739] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:54 2022] DELETE /identity/v3/projects/3de342438b854841a480f1c6577fb081 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:54.796162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5dac-00c6-4f84-a5d1-764d8430b5ce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:54.797108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5dac-00c6-4f84-a5d1-764d8430b5ce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:54.797453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5dac-00c6-4f84-a5d1-764d8430b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:54.949045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0e8a5dac-00c6-4f84-a5d1-764d8430b5ce None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:54.957619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0e8a5dac-00c6-4f84-a5d1-764d8430b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:54.974944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 872/1740] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:54.979950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:54.989310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 869/1741] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:55.001778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.003708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.013888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09b25d-ff1a-48c0-b3aa-9d572b247f69 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.021120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.029862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.030789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.032940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.033708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.036101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:55.038538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.047608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.088447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 873/1742] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:55.089765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.095000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:55.126095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923284c8-44bd-40e1-bf9f-08b44d516b15 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.142937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:55.147962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:55.148176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.152243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.152763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.153283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] PATH_INFO: `/v3/projects/672b029a611d4f52bad4de84d93570da` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.157297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=672b029a611d4f52bad4de84d93570da)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.159336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.217132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 870/1743] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:55.221515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.263004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3e71a-75a4-4018-ab9a-e053a15e61ed None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.282538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.283230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.283542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.283817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.284529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.312046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.377235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672b029a611d4f52bad4de84d93570da', 'request_id': 'req-a8a97a0d-13d8-423f-adad-472a8c6611ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:55.392653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672b029a611d4f52bad4de84d93570da', 'request_id': 'req-a8a97a0d-13d8-423f-adad-472a8c6611ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:55.417825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672b029a611d4f52bad4de84d93570da', 'request_id': 'req-a8a97a0d-13d8-423f-adad-472a8c6611ce'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:55.437033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 871/1744] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:55 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:55.437033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.483023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] The token cache is being invalidate because project 672b029a611d4f52bad4de84d93570da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:44:55.483433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:55.486148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:55.487932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 874/1745] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:55 2022] DELETE /identity/v3/projects/672b029a611d4f52bad4de84d93570da => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:55.491858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.500125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:55.701549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadfec-6de1-4a0e-a1a0-9a8e64a7e205 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.708720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.709583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.709877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.710160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.711901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:44:55.717588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.721273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.753511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 872/1746] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:44:55.754372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.764896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:55.795690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7ef-ed5e-446f-905e-1c2061a95c93 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.811321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.813033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.813033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.813033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] PATH_INFO: `/v3/users/0e5e057889b741d587a70ed7b91bd4b7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.816246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5e057889b741d587a70ed7b91bd4b7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.818181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.838247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97a0d-13d8-423f-adad-472a8c6611ce admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:55.856238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:55.856967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:55.857265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:55.857550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:55.858364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:55.860564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:55.947948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 875/1747] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:55 2022] POST /identity/v3/users => generated 291 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:55.948919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:55.971276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:55.983971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5e057889b741d587a70ed7b91bd4b7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:56.011201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5e057889b741d587a70ed7b91bd4b7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:56.017877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534bfec-1e1c-420b-8ce2-824a26e589fb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.052814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.056481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.057939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5e057889b741d587a70ed7b91bd4b7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:56.058064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.058440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.059753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5e057889b741d587a70ed7b91bd4b7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:56.061340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5e057889b741d587a70ed7b91bd4b7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:44:56.062013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.072423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.107316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 873/1748] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:44:55 2022] DELETE /identity/v3/users/0e5e057889b741d587a70ed7b91bd4b7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:56.110272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.114019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:56.169605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 876/1749] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:55 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:56.174491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.180549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:56.322529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346c5ef-24a3-4dd1-a130-7d87dad0e32c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.337998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.338960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.339083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.339276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.342943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.344903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.374177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615ffd6-98c9-4b6c-9a18-9c8d52a6a461 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.384210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.384999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.385292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.385576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.386440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.388253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.405429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 877/1750] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:56 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:56.420874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.431144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 874/1751] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:56.436502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.448254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d61c8-7fc1-47c6-91a3-8ddbb16bbe41 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.479099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de540b-5942-432d-be71-034019f2e83e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.488339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.489053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.489473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.489766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.490529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.493650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.499888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.500595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.500890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.501178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.501934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.507746 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.542351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 878/1752] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:56.548196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.565197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 875/1753] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:56.574826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.592500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c8b32-39fb-435c-9985-b1d2596af941 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.613951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42c30-ca26-41b3-9d1b-77e10a747af1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.614143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.614694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.615053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.615423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.616267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.618384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.635839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.636964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.637480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.637860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] PATH_INFO: `/v3/projects/c1a0d44fd246445aa04b360404c401e7/users/15e717c801f64449bdf7a7d92aba7b0e/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.655875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 879/1754] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:56.659330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:56.673342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a0d44fd246445aa04b360404c401e7, user_id=15e717c801f64449bdf7a7d92aba7b0e, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.683122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a540984-f244-43a2-9663-41f9cd401883 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.694954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dbd33-307a-4792-9c9e-d6f16e4650eb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:56.715974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:56.716997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.717300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.717586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] PATH_INFO: `/v3/projects/421bc661aba04138be09b0fad5c4ccef/users/9338c1e0e8bb4d40ae97a1ab61648fa7/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.737734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 876/1755] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:56 2022] PUT /identity/v3/projects/c1a0d44fd246445aa04b360404c401e7/users/15e717c801f64449bdf7a7d92aba7b0e/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:56.739317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913614-766b-4bb1-93f2-9ce0f08b3895 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.739636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913614-766b-4bb1-93f2-9ce0f08b3895 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.739926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc913614-766b-4bb1-93f2-9ce0f08b3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.783042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421bc661aba04138be09b0fad5c4ccef, user_id=9338c1e0e8bb4d40ae97a1ab61648fa7, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:56.786794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8377e6-d69a-495a-856d-d7b371767369 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:56.836858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 880/1756] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:56 2022] PUT /identity/v3/projects/421bc661aba04138be09b0fad5c4ccef/users/9338c1e0e8bb4d40ae97a1ab61648fa7/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:56.838708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:56.839080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:56.839507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:56.845539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fc913614-766b-4bb1-93f2-9ce0f08b3895 None None] MFA Rules not processed for user `15e717c801f64449bdf7a7d92aba7b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:56.847051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fc913614-766b-4bb1-93f2-9ce0f08b3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:56.931903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] MFA Rules not processed for user `9338c1e0e8bb4d40ae97a1ab61648fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:56.933477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:57.055484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 877/1757] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:57.060660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1b17-cde2-4de2-a7e6-6223e98f9621 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.061592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1b17-cde2-4de2-a7e6-6223e98f9621 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.062539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a1b17-cde2-4de2-a7e6-6223e98f9621 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.066684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 878/1758] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:44:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:44:57.068457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a1b17-cde2-4de2-a7e6-6223e98f9621 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.108330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 881/1759] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:57.112820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.257178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a1b17-cde2-4de2-a7e6-6223e98f9621 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.305252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ae8fb-e092-4f9d-82bb-0f73310bda20 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.307261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.308062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.308354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.308682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.309468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.312144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.313900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.314423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.314901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.316049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.317891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.319126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891ba9-bc26-497a-b81b-c4ff72183b9c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.376335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 882/1760] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:57 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:57.379185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.379940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.380433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.408957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 879/1761] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:44:57 2022] POST /identity/v3/projects => generated 381 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:57.412569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.464267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:57.472893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:57.656254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f32785-590d-42b7-af65-0e27fd8d8949 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.673982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.676126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.676675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.676961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.677848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.679684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 883/1762] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:44:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:57.681066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.681801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.696365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b550bf8-3a0f-49c1-bb08-540f23dd70b7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.702835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.703669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.704082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.704567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.705540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.707790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.750871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 884/1763] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:57 2022] POST /identity/v3/users => generated 297 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:57.757415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.776564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 880/1764] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:44:57 2022] POST /identity/v3/users => generated 298 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:44:57.776564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.781592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:57.787951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b906-2247-4152-9e58-ff9a26fef005 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.798643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.799558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.799967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.800322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.801396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.807405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.822708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 885/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:57.823707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.839335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f343-f4d1-49a1-ba7e-507ab10552b0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.846612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.849190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.849585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.853224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.853759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.859478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.879977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 886/1766] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:57.879977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:57.896546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805700-4bab-4b4c-9005-0e3d5569be10 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.898285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22b8d-bf53-49f5-9977-6247d2552a91 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:57.905792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.907404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.907817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.908274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] PATH_INFO: `/v3/projects/b42604f51f6843a1a0501a33a4ca927c/users/62d0b94ebbfa487b80f83e02339b989a/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.920042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:57.920914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:57.922235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:57.922581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:57.932863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42604f51f6843a1a0501a33a4ca927c, user_id=62d0b94ebbfa487b80f83e02339b989a, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.936371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.955230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:57.961842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:57.963224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 887/1767] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:57 2022] PUT /identity/v3/projects/b42604f51f6843a1a0501a33a4ca927c/users/62d0b94ebbfa487b80f83e02339b989a/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:57.964081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.000324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 881/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:58.002589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.017401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebca33-dde7-4e2b-a29a-752a8f9ba3c5 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.153523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441312f3-4aff-4a38-9216-c98082896a07 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.171090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:58.172292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.172292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.172610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] PATH_INFO: `/v3/projects/bb47510b8a1548798b29fba9f46be0f6/users/17992ab5c6554c38b42bc549f3aafe6c/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.190879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:58.191817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.192331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.192752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.193657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:58.196777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:58.209250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 882/1769] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:44:58.216332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.234735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb47510b8a1548798b29fba9f46be0f6, user_id=17992ab5c6554c38b42bc549f3aafe6c, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:58.237537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:58.239408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfb71-2049-41cb-ab88-68f22bad6307 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.254197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:58.256615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.257493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.257835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] PATH_INFO: `/v3/projects/b42604f51f6843a1a0501a33a4ca927c/users/62d0b94ebbfa487b80f83e02339b989a/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.260903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 888/1770] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:57 2022] PUT /identity/v3/projects/bb47510b8a1548798b29fba9f46be0f6/users/17992ab5c6554c38b42bc549f3aafe6c/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:58.262814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42604f51f6843a1a0501a33a4ca927c, user_id=62d0b94ebbfa487b80f83e02339b989a, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:58.265606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.270307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23854b-b059-4322-abc2-a9d492a2a431 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:58.300271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 883/1771] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:58 2022] PUT /identity/v3/projects/b42604f51f6843a1a0501a33a4ca927c/users/62d0b94ebbfa487b80f83e02339b989a/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:58.311385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.311695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.311976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.371131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] MFA Rules not processed for user `62d0b94ebbfa487b80f83e02339b989a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:58.373670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:58.464076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327021f1-334b-4205-ba51-25336bc01865 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.593157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 884/1772] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:58.607673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.610056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:58.650945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:58.655116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.667103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.667586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.673187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:58.675055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:58.711648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 889/1773] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:44:58.712916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:58.744081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214dfb84-a556-41d5-a7ef-4745c1bc6fe9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.753236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:58.754421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.754848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.755270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] PATH_INFO: `/v3/projects/bb47510b8a1548798b29fba9f46be0f6/users/17992ab5c6554c38b42bc549f3aafe6c/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.757673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb47510b8a1548798b29fba9f46be0f6, user_id=17992ab5c6554c38b42bc549f3aafe6c, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:58.762968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2cd08-1fef-486f-9dc9-da14fb15ddcf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:58.819635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 890/1774] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:44:58 2022] PUT /identity/v3/projects/bb47510b8a1548798b29fba9f46be0f6/users/17992ab5c6554c38b42bc549f3aafe6c/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:44:58.826471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27731f5-0690-4d42-bdd5-c5da7ae100d7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:58.829788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9996d-1bf6-47a2-9db6-2dce9bfec334 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:58.830153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9996d-1bf6-47a2-9db6-2dce9bfec334 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:58.830293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9996d-1bf6-47a2-9db6-2dce9bfec334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:58.936087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9ac9996d-1bf6-47a2-9db6-2dce9bfec334 None None] MFA Rules not processed for user `17992ab5c6554c38b42bc549f3aafe6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:58.938137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ac9996d-1bf6-47a2-9db6-2dce9bfec334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:59.079103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:59.080206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:59.080850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:59.081333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:59.155776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 891/1775] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:59.159064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:59.159531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:59.162655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:59.245033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] MFA Rules not processed for user `ed37128b78a6454c9c387ad91995a05d`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:44:59.246680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:59.329972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:59.337511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:59.398779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 885/1776] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:59.400728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:59.405432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 892/1777] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:44:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:44:59.412703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:59.434217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9816194-2164-4fb3-876c-36043780403d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:59.455125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:59.473349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:59.474854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:59.477464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:44:59.526181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:44:59.530024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:44:59.576290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 886/1778] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:44:59.679202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:59.683720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:44:59.916831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:44:59.935414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6d1d-2643-4754-8ee7-0669cb66edcc service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:44:59.957910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:44:59.958593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:44:59.958883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:44:59.959168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:00.026989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2518f3-be63-43b5-92df-e08f8c3f94bc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:00.054291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:00.058892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:00.059199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:00.059534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] PATH_INFO: `/v3/projects/512b65a94464429f97f2dffbe803750c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:00.069577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=512b65a94464429f97f2dffbe803750c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:00.081658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:00.193985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:00.203122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:00.229211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 887/1779] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:44:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:00.236663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512b65a94464429f97f2dffbe803750c', 'request_id': 'req-88e7ec12-2bf0-4368-8752-39dfb547b89b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:00.248142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512b65a94464429f97f2dffbe803750c', 'request_id': 'req-88e7ec12-2bf0-4368-8752-39dfb547b89b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:00.275016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512b65a94464429f97f2dffbe803750c', 'request_id': 'req-88e7ec12-2bf0-4368-8752-39dfb547b89b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:00.314864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:00.325589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] The token cache is being invalidate because project 512b65a94464429f97f2dffbe803750c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:00.325888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:00.327954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0a67-8efd-439c-9952-8706d57dd025 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:00.335323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-88e7ec12-2bf0-4368-8752-39dfb547b89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:00.337911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 893/1780] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:44:59 2022] DELETE /identity/v3/projects/512b65a94464429f97f2dffbe803750c => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:00.345726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98133ea4-8949-4df6-9255-09c21b03d0c1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:00.356118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98133ea4-8949-4df6-9255-09c21b03d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:00.356399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98133ea4-8949-4df6-9255-09c21b03d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:00.452647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-98133ea4-8949-4df6-9255-09c21b03d0c1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:00.461689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-98133ea4-8949-4df6-9255-09c21b03d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:00.540112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:00.541214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:00.542147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:00.542761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:00.545434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:00.626904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 894/1781] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:00.639782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:00.641362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:00.654558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:00.839986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:00.850634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:00.907907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 888/1782] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:01.029087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:01.035129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:01.078220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.078944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 895/1783] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:01.105759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f762f0-57e5-47ba-897e-cd6484cb8c4d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.124391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.127473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.128627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.130154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.134171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:01.135191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.140618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.185574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 889/1784] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:45:01.186758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.209906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c4905-cc04-4331-8f87-b9cfc29f31e1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.236013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.236723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.237017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.237301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.238218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.240241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.339013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 896/1785] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:01 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:01.343516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.354528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc31b13-8fc7-4b96-a644-5217aeec1c72 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.514659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.517377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.518280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.520447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.523165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.530598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.610952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.613853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:01.634533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8963-52e5-44b1-b610-0b007feecbf1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.648086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 890/1786] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:01 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:01.653913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.654133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.655044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.655333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.655642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] PATH_INFO: `/v3/users/9338c1e0e8bb4d40ae97a1ab61648fa7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.657038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9338c1e0e8bb4d40ae97a1ab61648fa7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.659290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.689054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e64f32-aeca-46e2-a75c-f90b9e8a0ae1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.700004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.701922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.702344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.714691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.716543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.719845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.739440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 891/1787] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:01.745654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.769851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9338c1e0e8bb4d40ae97a1ab61648fa7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:01.770733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9338c1e0e8bb4d40ae97a1ab61648fa7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:01.772410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb893-729b-4cba-85f2-c593bbfb4370 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.784145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.784836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.785129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.785411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.786144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:01.787982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:01.792092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9338c1e0e8bb4d40ae97a1ab61648fa7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:01.793975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9338c1e0e8bb4d40ae97a1ab61648fa7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:01.805804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b73758d0-618a-4e27-aabb-214d0bb93c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9338c1e0e8bb4d40ae97a1ab61648fa7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:01.816661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 892/1788] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:01.821150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:01.826713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:01.827971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 897/1789] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:01 2022] DELETE /identity/v3/users/9338c1e0e8bb4d40ae97a1ab61648fa7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:01.833449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38f49-09d7-4043-a227-a68d296ffa72 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.833753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38f49-09d7-4043-a227-a68d296ffa72 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.834042 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c38f49-09d7-4043-a227-a68d296ffa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:01.869757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc450b35-68ce-4c1c-b3ed-fd658b11a68b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:01.898256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c3c38f49-09d7-4043-a227-a68d296ffa72 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:01.901210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c3c38f49-09d7-4043-a227-a68d296ffa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:01.991231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:01.994423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:01.996621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:01.997085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] PATH_INFO: `/v3/projects/cbb6dc8a49c74ee8a24a2c6dadb7ee5c/users/9b578d79b7914798a37afcb732f2da6b/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.026012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb6dc8a49c74ee8a24a2c6dadb7ee5c, user_id=9b578d79b7914798a37afcb732f2da6b, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.031150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.042765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 898/1790] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:02.044722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ee6-ff76-4128-a3a2-8214ee12e20d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.045142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ee6-ff76-4128-a3a2-8214ee12e20d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.045543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0ee6-ff76-4128-a3a2-8214ee12e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.078806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 893/1791] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:01 2022] PUT /identity/v3/projects/cbb6dc8a49c74ee8a24a2c6dadb7ee5c/users/9b578d79b7914798a37afcb732f2da6b/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:02.080483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.084424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-be9a0ee6-ff76-4128-a3a2-8214ee12e20d None None] MFA Rules not processed for user `e6a99e5d684a48a2845d3379e7df812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:02.085648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be9a0ee6-ff76-4128-a3a2-8214ee12e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.088474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.185863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 899/1792] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:02.187319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.187651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.187940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.205726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ba489-cdce-48d9-a8fe-0c491a3121af admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:02.213636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:02.214646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.214939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.215221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.225544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] MFA Rules not processed for user `9b578d79b7914798a37afcb732f2da6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:02.227825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.363507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 900/1793] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:02.364511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.366099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.385465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.387101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.399747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 894/1794] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:02.400687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.411969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501fda8-162a-4b21-a708-1d218aaff303 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:02.417626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:02.418316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.418602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.418885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.419647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.421608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.452440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 895/1795] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:02.473488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.478538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486b40f-9cbc-4719-a528-8c2fe69f0636 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:02.647651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb70c74-7a91-4444-a4a5-a29b08d870b9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:02.656926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:02.657720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.658426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.658426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.659317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.664837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa994f-00da-489d-adfa-513b316d5f33 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.684986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:02.686526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.687065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.687971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] PATH_INFO: `/v3/users/2dcce9f3178344dba7ecaf751dd08713` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.690339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcce9f3178344dba7ecaf751dd08713)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.693444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.701681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 896/1796] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:02.703665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a880d-fb1c-4899-bac4-99b067ff224a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.704897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a880d-fb1c-4899-bac4-99b067ff224a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.706432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a880d-fb1c-4899-bac4-99b067ff224a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.710081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 897/1797] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:45:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:45:02.713288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a880d-fb1c-4899-bac4-99b067ff224a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.758761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a880d-fb1c-4899-bac4-99b067ff224a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:02.778265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:02.779157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.779486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.780662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.781581 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:02.785173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d256408-22df-4a14-952b-9b87df7d10a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:02.815344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 898/1798] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:02.815344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31fa5-f239-4501-82ec-28672344110d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.815344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31fa5-f239-4501-82ec-28672344110d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.815344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed31fa5-f239-4501-82ec-28672344110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:02.856181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcce9f3178344dba7ecaf751dd08713'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:02.857244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcce9f3178344dba7ecaf751dd08713'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:02.872511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8ed31fa5-f239-4501-82ec-28672344110d None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:02.873756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8ed31fa5-f239-4501-82ec-28672344110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.876585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcce9f3178344dba7ecaf751dd08713'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:02.877515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcce9f3178344dba7ecaf751dd08713'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:02.897520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcce9f3178344dba7ecaf751dd08713'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:02.922289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 901/1799] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:02 2022] DELETE /identity/v3/users/2dcce9f3178344dba7ecaf751dd08713 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:02.923708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:02.926600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:02.983057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 899/1800] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:02.984605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:02.984891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:02.985209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.005463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:03.006496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.105958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 900/1801] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:03.110109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df878d7-e8a4-4056-b6bb-d9581f487418 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.115289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.116252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.116541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.116897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] PATH_INFO: `/v3/projects/e151df2c45d24c85b92d7e29015d8d73/users/0eca6aac6f634d09b034e72973c19a21/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.144037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e151df2c45d24c85b92d7e29015d8d73, user_id=0eca6aac6f634d09b034e72973c19a21, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.150054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.174028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 902/1802] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:02 2022] PUT /identity/v3/projects/e151df2c45d24c85b92d7e29015d8d73/users/0eca6aac6f634d09b034e72973c19a21/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:03.175010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.185278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131be402-2b2a-427e-90df-27a88d1f2262 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.221749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.225823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.299976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.300838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.301138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.301422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.302183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.304877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.322710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 901/1803] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:03.324636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.338065 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b642c8-237c-48e3-90bb-3349412ca81e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.350185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.350898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.351185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.351573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.355102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b51c7-49f7-42cb-99d5-c5a362afe80a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.363071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.364841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9cd7f-de76-4d07-9dc0-d1a42bd03265 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.370790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.371805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.372144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.372432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] PATH_INFO: `/v3/projects/e151df2c45d24c85b92d7e29015d8d73/users/0eca6aac6f634d09b034e72973c19a21/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.374899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e151df2c45d24c85b92d7e29015d8d73, user_id=0eca6aac6f634d09b034e72973c19a21, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.376896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 903/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:03.378109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.409114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 902/1805] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:03 2022] PUT /identity/v3/projects/e151df2c45d24c85b92d7e29015d8d73/users/0eca6aac6f634d09b034e72973c19a21/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:03.410591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.410869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.411922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.454786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] MFA Rules not processed for user `0eca6aac6f634d09b034e72973c19a21`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:03.459775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.574610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 904/1806] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:03.590027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.593891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.685320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df97fb4b-8875-49f3-9ea4-03e998898887 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.689779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.690614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.691304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.691762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.705961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.708580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.744091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 903/1807] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:03.837342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.837342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.852348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e474aa-fd0b-467e-a9f4-8c8ef1abb007 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:03.857797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:03.858886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:03.859404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:03.859773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:03.861737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:03.956852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:03.958410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:03.969921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 905/1808] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:03.980995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:03.982462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:04.064352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:04.066734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:04.185784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed554-4b26-4603-a56c-b05b5b270b62 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:04.196717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:04.197648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:04.197932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:04.198207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] PATH_INFO: `/v3/projects/421bc661aba04138be09b0fad5c4ccef` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:04.199656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=421bc661aba04138be09b0fad5c4ccef)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:04.202066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:04.207250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d02-ab58-4a6f-aaa3-f597e2007ed0 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:04.216391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:04.217817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:04.219772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:04.220359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:04.247442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:04.256013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:04.294871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 906/1809] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:04.367655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:04.369164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:04.380249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421bc661aba04138be09b0fad5c4ccef', 'request_id': 'req-9a4d1f13-b894-478c-984a-263e0bed9b8e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.404503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421bc661aba04138be09b0fad5c4ccef', 'request_id': 'req-9a4d1f13-b894-478c-984a-263e0bed9b8e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.415543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac321-c753-41b8-89af-d2d322fb05d4 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:04.428416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421bc661aba04138be09b0fad5c4ccef', 'request_id': 'req-9a4d1f13-b894-478c-984a-263e0bed9b8e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.473113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] The token cache is being invalidate because project 421bc661aba04138be09b0fad5c4ccef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:04.474399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.475302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.483077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 904/1810] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:03 2022] DELETE /identity/v3/projects/421bc661aba04138be09b0fad5c4ccef => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:04.490981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:04.493991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:04.642452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:04.645940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:04.646237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:04.646524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] PATH_INFO: `/v3/projects/dd780ae610b8443b9aa035883f29c37b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:04.654568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd780ae610b8443b9aa035883f29c37b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:04.658413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:04.666236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d1f13-b894-478c-984a-263e0bed9b8e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:04.678789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:04.681073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:04.681366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:04.681653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] PATH_INFO: `/v3/users/17992ab5c6554c38b42bc549f3aafe6c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:04.688733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=17992ab5c6554c38b42bc549f3aafe6c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:04.694128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:04.826351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd780ae610b8443b9aa035883f29c37b', 'request_id': 'req-9c9ab0b1-295f-4401-bc85-6654176361ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.838526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd780ae610b8443b9aa035883f29c37b', 'request_id': 'req-9c9ab0b1-295f-4401-bc85-6654176361ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.848368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd780ae610b8443b9aa035883f29c37b', 'request_id': 'req-9c9ab0b1-295f-4401-bc85-6654176361ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.861686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] The token cache is being invalidate because project dd780ae610b8443b9aa035883f29c37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:04.862014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.862826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.867418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 907/1811] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:04 2022] DELETE /identity/v3/projects/dd780ae610b8443b9aa035883f29c37b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:04.871299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17992ab5c6554c38b42bc549f3aafe6c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.876553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:04.880954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:04.886652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17992ab5c6554c38b42bc549f3aafe6c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.913995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17992ab5c6554c38b42bc549f3aafe6c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.916025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17992ab5c6554c38b42bc549f3aafe6c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.916969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17992ab5c6554c38b42bc549f3aafe6c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:04.948456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 905/1812] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:04 2022] DELETE /identity/v3/users/17992ab5c6554c38b42bc549f3aafe6c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:05.008656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ab0b1-295f-4401-bc85-6654176361ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.130542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.131948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.132340 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.132749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] PATH_INFO: `/v3/users/bd7dfa2ed50540e5bab6abd2b04441dd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.134768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7dfa2ed50540e5bab6abd2b04441dd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.136856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.193658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7dfa2ed50540e5bab6abd2b04441dd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.194367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7dfa2ed50540e5bab6abd2b04441dd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.211395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7dfa2ed50540e5bab6abd2b04441dd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.212367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7dfa2ed50540e5bab6abd2b04441dd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.223653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d2654cce-d7fb-4e63-9604-b6f636076824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7dfa2ed50540e5bab6abd2b04441dd'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.238644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 908/1813] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:04 2022] DELETE /identity/v3/users/bd7dfa2ed50540e5bab6abd2b04441dd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:05.373703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.375314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.389865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf80f31-2bc4-460d-adc9-eda64391bdee admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.454907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.455734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.456028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.456293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] PATH_INFO: `/v3/projects/bb47510b8a1548798b29fba9f46be0f6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.458000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb47510b8a1548798b29fba9f46be0f6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.461401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.513422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb47510b8a1548798b29fba9f46be0f6', 'request_id': 'req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.520620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb47510b8a1548798b29fba9f46be0f6', 'request_id': 'req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.533502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb47510b8a1548798b29fba9f46be0f6', 'request_id': 'req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.548487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] The token cache is being invalidate because project bb47510b8a1548798b29fba9f46be0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:05.548807 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.549538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.552032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 906/1814] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:05 2022] DELETE /identity/v3/projects/bb47510b8a1548798b29fba9f46be0f6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:05.558057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f930e3-7a79-4ba8-91fc-18f2e5da660f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.558783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f930e3-7a79-4ba8-91fc-18f2e5da660f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.558783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f930e3-7a79-4ba8-91fc-18f2e5da660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.590477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e0f930e3-7a79-4ba8-91fc-18f2e5da660f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:05.591772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e0f930e3-7a79-4ba8-91fc-18f2e5da660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.602668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.605134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.693951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 909/1815] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:05.696890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.697188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.697544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.713070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4441-4d09-41a7-9bd9-6dc627d3d05f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.718551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:05.719816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.723064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.724013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.724307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.724595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] PATH_INFO: `/v3/projects/f10a9c8167384c409fd263e1d9e89b47` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.725832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10a9c8167384c409fd263e1d9e89b47)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.727876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.728511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 910/1816] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:05.734574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.743946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaccb6-d99d-4217-847d-4f6324aefa25 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.748810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.749486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.749773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.750052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.750793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:05.751103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.752745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.766229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 911/1817] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:05.770786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.780981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10a9c8167384c409fd263e1d9e89b47', 'request_id': 'req-9b40c185-c0ff-499d-ae8c-f9693d2e282b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.781624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30b4b-d844-43da-bf62-f57ba5587086 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.787094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10a9c8167384c409fd263e1d9e89b47', 'request_id': 'req-9b40c185-c0ff-499d-ae8c-f9693d2e282b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.795779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10a9c8167384c409fd263e1d9e89b47', 'request_id': 'req-9b40c185-c0ff-499d-ae8c-f9693d2e282b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.806471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] The token cache is being invalidate because project f10a9c8167384c409fd263e1d9e89b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:05.806786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.807549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9b40c185-c0ff-499d-ae8c-f9693d2e282b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:05.813640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 907/1818] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:05 2022] DELETE /identity/v3/projects/f10a9c8167384c409fd263e1d9e89b47 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:05.815045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565f42-6c9d-4641-b525-52cf2fdad0e5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.815294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565f42-6c9d-4641-b525-52cf2fdad0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.815612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5565f42-6c9d-4641-b525-52cf2fdad0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.841686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b5565f42-6c9d-4641-b525-52cf2fdad0e5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:05.842883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b5565f42-6c9d-4641-b525-52cf2fdad0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.845400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.846080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.846371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.846652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.847516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.849451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.851277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 908/1819] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:05.858913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.859207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.859616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.877037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 912/1820] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:05.880946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:05.881066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.882164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.882642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:05.940943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 909/1821] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:05.945753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.946057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72883eb5-772a-48a8-9266-2d12666c17b4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.951597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.952278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.952566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.952844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.953540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.954769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e7605-04ea-41df-9e61-dc1ffa8a2b5e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.955466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.959594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:05.960399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:05.960857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:05.961463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:05.962488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:05.962702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:05.964736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:05.981867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 913/1822] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:05.982067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 910/1823] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:45:05.983099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.986407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:05.996570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678afc9-49c4-4e57-a4d4-23c10ef8ad94 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:05.997026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7afc-8ceb-4928-9cf7-7d1125f886d7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.002025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.002164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.002809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.002911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.003099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.003261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.003434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.003685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.004205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.004497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.005929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.006530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.020182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 914/1824] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:06.021535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.035130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c34b5-9183-4fd0-8649-fdf6c06835ce admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.042001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.043049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.043572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.044692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.045850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.048945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 911/1825] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:05 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:06.049911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.055171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.064869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 915/1826] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:06.068687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.080443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8954-10f9-4c82-af95-d0a451130993 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.125738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590b0f5-698b-4c94-ae6c-ad623c02e260 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.130678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.131463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.131820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.132442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.133752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.135792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.139204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.140258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.140616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.140964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] PATH_INFO: `/v3/projects/44805902903d4d0a8f1fc68bbd8370ba/users/456c34b25e404cf9b7aeb72dbbb4f5f8/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.157333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44805902903d4d0a8f1fc68bbd8370ba, user_id=456c34b25e404cf9b7aeb72dbbb4f5f8, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.159647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 912/1827] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:06.160160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825034d6-b1b6-447a-93ac-c0193405e48d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.164083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.174607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 916/1828] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:06 2022] PUT /identity/v3/projects/44805902903d4d0a8f1fc68bbd8370ba/users/456c34b25e404cf9b7aeb72dbbb4f5f8/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:06.176431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9c9f3-8c76-485c-bb88-ce3d3463724e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.186505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.186800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.187082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.215887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] MFA Rules not processed for user `456c34b25e404cf9b7aeb72dbbb4f5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:06.217128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.240220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.240900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.241193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.241477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.242283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.243975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.254674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 913/1829] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:06.259305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.268858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd312e-0213-4d31-9db0-228cd7dbf820 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.274199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.274858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.275149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.275552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.276285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.277889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.286295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 917/1830] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:06.291697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 914/1831] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:06.292763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.297854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.299573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.303385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a0761-38db-456d-9f5a-f1c5b25843b9 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.308308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.309194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.309474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.309795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] PATH_INFO: `/v3/projects/51d7563e08bc47c3b4a4a75eba8146da/users/efa4d9ab93bc472ea9a6670a64c82845/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.326083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d7563e08bc47c3b4a4a75eba8146da, user_id=efa4d9ab93bc472ea9a6670a64c82845, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.328791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2c78b-ef95-477a-8755-f236f79a8033 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.345418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 918/1832] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:06 2022] PUT /identity/v3/projects/51d7563e08bc47c3b4a4a75eba8146da/users/efa4d9ab93bc472ea9a6670a64c82845/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:06.355950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.356246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.356529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.365083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e8fde-12af-497b-863d-431ec0d46bbe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.385108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] MFA Rules not processed for user `efa4d9ab93bc472ea9a6670a64c82845`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:06.386251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.429120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.429865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.430225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.430515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.456504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 919/1833] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:06.460593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.491130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.492691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.501589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 915/1834] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:06.521995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.527167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333968cb-cb60-418a-8b1d-6fbf8ff5fc8b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.531920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.532588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.532905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.533237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.533425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbfe01-e2ad-4d7f-9f3a-12f366baf630 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.533941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.535881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.538672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.539809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.540105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.540385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] PATH_INFO: `/v3/users/456c34b25e404cf9b7aeb72dbbb4f5f8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.541611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=456c34b25e404cf9b7aeb72dbbb4f5f8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.543556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.564372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 920/1835] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:06.565366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.593035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456c34b25e404cf9b7aeb72dbbb4f5f8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:06.601565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456c34b25e404cf9b7aeb72dbbb4f5f8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:06.618454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456c34b25e404cf9b7aeb72dbbb4f5f8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:06.619425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456c34b25e404cf9b7aeb72dbbb4f5f8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:06.620118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d4009989-4778-495c-9822-ccd16fa55a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456c34b25e404cf9b7aeb72dbbb4f5f8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:06.632312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 916/1836] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:06 2022] DELETE /identity/v3/users/456c34b25e404cf9b7aeb72dbbb4f5f8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:06.635296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc650-4cc0-467b-9f10-f252c22aa005 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.637324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.637685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.637981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.654462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:06.655710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.700933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.701631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.701920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.702203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.703090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.705088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.732644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 921/1837] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:06.740589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.742826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.747859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 917/1838] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:06.757905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c41d-5f38-46c5-8fe2-917aeddd3064 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.758456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.760098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.763781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.764550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.764915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.765265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.766080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.767775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.779041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 922/1839] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:06.782914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.793130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ead1-1b47-43de-a56e-e156a494135b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.797831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.798526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.798819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.799101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.799877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.801468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.812474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 923/1840] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:06.816703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:06.818554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635d2a8-142f-4a4a-b999-876a06952fd7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.823277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.824008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.824302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.824586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.827801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bfa6b-9b8d-4a33-9453-9566015103d2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:06.833639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:06.834835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.835167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.836274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.836678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] PATH_INFO: `/v3/projects/c2f517ed65594713ad605736fd204566/users/31bf5bb57e4540e0bd27ec6b52306ca0/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.836924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3ae02-99e6-4573-b8a1-50d5bf5dbb63 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.846994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 918/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:06.852610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f517ed65594713ad605736fd204566, user_id=31bf5bb57e4540e0bd27ec6b52306ca0, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:06.855591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:06.869064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 924/1842] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:06 2022] PUT /identity/v3/projects/c2f517ed65594713ad605736fd204566/users/31bf5bb57e4540e0bd27ec6b52306ca0/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:06.880180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:06.880561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:06.880939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:06.909855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] MFA Rules not processed for user `31bf5bb57e4540e0bd27ec6b52306ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:06.910975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:06.978939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 919/1843] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:06.983074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.050612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683a7d-c814-4f2f-996f-1bd8866d56f1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.056151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.056825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.057109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.057384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.058083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.060076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.091546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 925/1844] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:06 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:07.092831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.106378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d8ae-1f89-4ccd-b45e-d817591ee12d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.139992 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.141885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.190124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.190815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.191102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.191406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.192286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.194306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.224673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f016-6ce4-4ee7-abd5-40a0a62d9674 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.230892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 920/1845] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:07.232268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.232814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.233698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.234133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.234443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] PATH_INFO: `/v3/projects/44805902903d4d0a8f1fc68bbd8370ba` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.235699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44805902903d4d0a8f1fc68bbd8370ba)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.237819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.246791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2dbe-96d9-4ccb-a671-6371b20af3ae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.252638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.253571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.253824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.254300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.255239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.257411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.276302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 921/1846] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:07.277528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.288467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ca6b-bc29-4b74-99ed-cbc11996b2fa admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.302515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44805902903d4d0a8f1fc68bbd8370ba', 'request_id': 'req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:07.314377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44805902903d4d0a8f1fc68bbd8370ba', 'request_id': 'req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:07.325019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44805902903d4d0a8f1fc68bbd8370ba', 'request_id': 'req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:07.341373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] The token cache is being invalidate because project 44805902903d4d0a8f1fc68bbd8370ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:07.341774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:07.342671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-31e80dba-0e0c-464f-95d6-bc9b24c78cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:07.344841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 926/1847] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:07 2022] DELETE /identity/v3/projects/44805902903d4d0a8f1fc68bbd8370ba => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:07.351731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732bc1-5a7f-4360-a3c6-c1808d16d92c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.352604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732bc1-5a7f-4360-a3c6-c1808d16d92c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.352903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73732bc1-5a7f-4360-a3c6-c1808d16d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.363992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.365009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.365298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.365583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] PATH_INFO: `/v3/projects/4f597916bb67441e9dde61b1b5c2afc5/users/04a35504e1a049f89851316b299c7f58/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.384610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f597916bb67441e9dde61b1b5c2afc5, user_id=04a35504e1a049f89851316b299c7f58, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.385082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-73732bc1-5a7f-4360-a3c6-c1808d16d92c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:07.386318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-73732bc1-5a7f-4360-a3c6-c1808d16d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.387517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.401164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 927/1848] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:07.409235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.409449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.409570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.409861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 922/1849] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:07 2022] PUT /identity/v3/projects/4f597916bb67441e9dde61b1b5c2afc5/users/04a35504e1a049f89851316b299c7f58/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:07.414396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.419348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.428480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:07.430291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.486345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8023fd-9d1e-461e-b16d-00b6b3cc1abf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.492580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.493494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.493781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.493956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 928/1850] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:07.497114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.497114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.497114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.498628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.512640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 923/1851] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:07.512811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963443fa-18b7-4e8a-9969-0e4a30aab10f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.513711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.516448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.517129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.517416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.517696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.518533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:07.518753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.520453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.524833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82802022-8959-4de9-bb5d-7dcacb2b1669 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.530651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.531037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.531328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.531644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] PATH_INFO: `/v3/projects/4f597916bb67441e9dde61b1b5c2afc5/users/04a35504e1a049f89851316b299c7f58/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.533462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 929/1852] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:45:07.533726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f597916bb67441e9dde61b1b5c2afc5, user_id=04a35504e1a049f89851316b299c7f58, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.536439 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030f099-adc7-40ae-b76d-4a3118f2c549 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.537600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.548117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 924/1853] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:07 2022] PUT /identity/v3/projects/4f597916bb67441e9dde61b1b5c2afc5/users/04a35504e1a049f89851316b299c7f58/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:07.551585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4773-fb7a-4815-af1e-fe69b05742af admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.559315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.559652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.559929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.588985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] MFA Rules not processed for user `04a35504e1a049f89851316b299c7f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:07.590211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.618826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.619605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.619851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.620134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.621359 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.624164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.659547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 930/1854] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:07.660858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.664567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 925/1855] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:07.675477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.676902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.722858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2baca6-0961-475d-953c-2fe4c0cbe007 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.728194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.729261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.729261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.729559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.730177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.732127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.735529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893151-201a-43d2-84c0-ee1a33fe668f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.758055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 931/1856] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:07.762621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.777470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da113f-0884-498e-83c5-5405a6b6d603 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.783888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.784617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.784948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.785220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.786043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.788156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.801573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 932/1857] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:07.805653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.807713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.812895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.812895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.812895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.816594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203825a9-c82d-4d11-80ed-593d83549e05 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.823044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.823661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.823949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.824226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.824967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.826726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.839312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 933/1858] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:07.843640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.856096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707634e-a5a5-4351-b490-0b2c6be6b331 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:07.861904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:07.863055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.863055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.863345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] PATH_INFO: `/v3/projects/29260c09fcef4a49a7f9b244feca77cb/users/552433b497424e6fab5e83a5b3887d61/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.883825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29260c09fcef4a49a7f9b244feca77cb, user_id=552433b497424e6fab5e83a5b3887d61, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.887729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f71815-a365-41c8-9129-26884c55468f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.896578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:07.898109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:07.902689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 934/1859] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:07 2022] PUT /identity/v3/projects/29260c09fcef4a49a7f9b244feca77cb/users/552433b497424e6fab5e83a5b3887d61/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:07.908454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 926/1860] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:07.914408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:07.914768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:07.914969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:07.948092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] MFA Rules not processed for user `552433b497424e6fab5e83a5b3887d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:07.949225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.955868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:07.957309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:07.969303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56850-3853-4997-a553-4e0497209d53 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:08.019585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 935/1861] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:08.031762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:08.033840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:08.034495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:08.034780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:08.035051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:08.037176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:08.042372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a18b8-b508-45d4-84de-661d1c6e663b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:08.046102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:08.046766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:08.047055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:08.047346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:08.058063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:08.059577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0eb9ad-91bf-42bc-9e40-76cfd6cb8c49 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:08.071068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 936/1862] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:08.114336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:08.119527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:08.133484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 927/1863] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:09.562818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcae93-5814-40f2-86dd-62324f96478f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:09.563481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcae93-5814-40f2-86dd-62324f96478f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:09.563481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcae93-5814-40f2-86dd-62324f96478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:09.582275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0bbcae93-5814-40f2-86dd-62324f96478f None None] MFA Rules not processed for user `552433b497424e6fab5e83a5b3887d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:09.583829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0bbcae93-5814-40f2-86dd-62324f96478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:09.593172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 937/1864] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:11.399167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:11.401387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:11.514380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30981-f9f9-43a8-b0e6-430eb2140a54 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:11.527800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:11.528912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:11.530109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:11.530696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] PATH_INFO: `/v3/users/9b578d79b7914798a37afcb732f2da6b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:11.532449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b578d79b7914798a37afcb732f2da6b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:11.534659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:11.607734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b578d79b7914798a37afcb732f2da6b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.617238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b578d79b7914798a37afcb732f2da6b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.631049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b578d79b7914798a37afcb732f2da6b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.631049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b578d79b7914798a37afcb732f2da6b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.631444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b578d79b7914798a37afcb732f2da6b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.644935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 928/1865] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:11 2022] DELETE /identity/v3/users/9b578d79b7914798a37afcb732f2da6b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:11.650346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:11.650780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:11.651082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:11.671476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:11.673238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:11.752974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 938/1866] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:11.763620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:11.765284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:11.879943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:11.881177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef964-3b62-48cf-877e-1f50f3044456 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:11.882110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:11.887232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:11.888066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:11.888447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:11.888927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:11.899870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:11.902256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c16e9-c708-49ab-a7b6-5352ba24b6fc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:11.908880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082732c7-991b-436c-9f3f-a8602d40614a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:11.912954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 929/1867] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:11.916187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:11.917100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:11.917377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:11.917652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] PATH_INFO: `/v3/users/15e717c801f64449bdf7a7d92aba7b0e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:11.920403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e717c801f64449bdf7a7d92aba7b0e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:11.922952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:11.979304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e717c801f64449bdf7a7d92aba7b0e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.980288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e717c801f64449bdf7a7d92aba7b0e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:11.998482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e717c801f64449bdf7a7d92aba7b0e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.000743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e717c801f64449bdf7a7d92aba7b0e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.008983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e717c801f64449bdf7a7d92aba7b0e'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.021419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 939/1868] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:11 2022] DELETE /identity/v3/users/15e717c801f64449bdf7a7d92aba7b0e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:12.026789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.027162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.027550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.045764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:12.046986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.120191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 930/1869] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:12.131270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.134021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.206490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad6a8f-b366-4141-b592-80281ca40ac5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.211905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.212841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.213136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.213412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.220436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.222316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.236607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.237201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde6f47-532e-4a03-bc31-dc33861f7acf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.238490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.244375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.246450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.246450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.246450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] PATH_INFO: `/v3/projects/cbb6dc8a49c74ee8a24a2c6dadb7ee5c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.247522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb6dc8a49c74ee8a24a2c6dadb7ee5c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.250162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.250602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 940/1870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:12.310870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb6dc8a49c74ee8a24a2c6dadb7ee5c', 'request_id': 'req-16099325-41b2-4105-b4f6-722977609b2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.319541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb6dc8a49c74ee8a24a2c6dadb7ee5c', 'request_id': 'req-16099325-41b2-4105-b4f6-722977609b2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.330246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb6dc8a49c74ee8a24a2c6dadb7ee5c', 'request_id': 'req-16099325-41b2-4105-b4f6-722977609b2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.344430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] The token cache is being invalidate because project cbb6dc8a49c74ee8a24a2c6dadb7ee5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:12.344727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.345418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.350610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 931/1871] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:12 2022] DELETE /identity/v3/projects/cbb6dc8a49c74ee8a24a2c6dadb7ee5c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:12.352754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.372407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57098b5e-4591-4ab6-a16d-7aeda607d73d service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.452855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.453741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.454027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.454434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] PATH_INFO: `/v3/users/0eca6aac6f634d09b034e72973c19a21` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.455602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eca6aac6f634d09b034e72973c19a21)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.457484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.521068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eca6aac6f634d09b034e72973c19a21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.522515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eca6aac6f634d09b034e72973c19a21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.541851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eca6aac6f634d09b034e72973c19a21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.542735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eca6aac6f634d09b034e72973c19a21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.545181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.546834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.552087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eca6aac6f634d09b034e72973c19a21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.566577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 941/1872] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:12 2022] DELETE /identity/v3/users/0eca6aac6f634d09b034e72973c19a21 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:12.585043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16099325-41b2-4105-b4f6-722977609b2f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.657767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.659185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.659665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.660198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] PATH_INFO: `/v3/projects/c1a0d44fd246445aa04b360404c401e7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.661732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a0d44fd246445aa04b360404c401e7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.664359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.738036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a0d44fd246445aa04b360404c401e7', 'request_id': 'req-0a85f493-2c5d-4341-8f41-634efc06effa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.745252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.747754 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.750818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a0d44fd246445aa04b360404c401e7', 'request_id': 'req-0a85f493-2c5d-4341-8f41-634efc06effa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.760759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a0d44fd246445aa04b360404c401e7', 'request_id': 'req-0a85f493-2c5d-4341-8f41-634efc06effa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.772107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3191922-b58a-4965-8124-c8c4f04144b6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.775955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] The token cache is being invalidate because project c1a0d44fd246445aa04b360404c401e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:12.776399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.777188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.782489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 932/1873] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:12 2022] DELETE /identity/v3/projects/c1a0d44fd246445aa04b360404c401e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:12.783607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:12.785137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:12.866393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.867628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.868210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.868732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] PATH_INFO: `/v3/users/efa4d9ab93bc472ea9a6670a64c82845` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.870837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa4d9ab93bc472ea9a6670a64c82845)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.873630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.885542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85f493-2c5d-4341-8f41-634efc06effa admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:12.893735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:12.897839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:12.898973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:12.899688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] PATH_INFO: `/v3/users/62d0b94ebbfa487b80f83e02339b989a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:12.902228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d0b94ebbfa487b80f83e02339b989a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:12.904590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:12.971904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa4d9ab93bc472ea9a6670a64c82845'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.972785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa4d9ab93bc472ea9a6670a64c82845'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.979920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d0b94ebbfa487b80f83e02339b989a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.986719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa4d9ab93bc472ea9a6670a64c82845'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.989360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d0b94ebbfa487b80f83e02339b989a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:12.997450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa4d9ab93bc472ea9a6670a64c82845'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.009756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d0b94ebbfa487b80f83e02339b989a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.010243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1f1bce24-9a3a-4a9e-80d2-a2e8733887cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa4d9ab93bc472ea9a6670a64c82845'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.010791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d0b94ebbfa487b80f83e02339b989a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.011648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d0b94ebbfa487b80f83e02339b989a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.025987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 933/1874] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:12 2022] DELETE /identity/v3/users/62d0b94ebbfa487b80f83e02339b989a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:13.026159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 942/1875] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:12 2022] DELETE /identity/v3/users/efa4d9ab93bc472ea9a6670a64c82845 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:13.029644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:13.032222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.043342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.043811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.044102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.086912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:13.088015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.141384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daf082-f1c6-4106-ac25-1b5916f5ca9c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:13.203138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 943/1876] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:13.214765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:13.217157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.250137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:13.251703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.252219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.252719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] PATH_INFO: `/v3/projects/e151df2c45d24c85b92d7e29015d8d73` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.254547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e151df2c45d24c85b92d7e29015d8d73)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:13.256501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:13.314369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe04a6-3b5c-4787-8e0c-a529ba2a330c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:13.323689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:13.324898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.325114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.325406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.338411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:13.339991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888f261-943f-4ced-bc33-2d369c22504b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:13.345094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e151df2c45d24c85b92d7e29015d8d73', 'request_id': 'req-80990e84-dd6a-4ea7-bdd7-02307a1ef425'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.352559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 944/1877] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:13.354988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e151df2c45d24c85b92d7e29015d8d73', 'request_id': 'req-80990e84-dd6a-4ea7-bdd7-02307a1ef425'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.378556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e151df2c45d24c85b92d7e29015d8d73', 'request_id': 'req-80990e84-dd6a-4ea7-bdd7-02307a1ef425'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.394911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] The token cache is being invalidate because project e151df2c45d24c85b92d7e29015d8d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:13.395597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.396490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.398516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 934/1878] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:13 2022] DELETE /identity/v3/projects/e151df2c45d24c85b92d7e29015d8d73 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:13.406284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab04-1f97-4d58-b430-6e4df0464d9e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.407246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab04-1f97-4d58-b430-6e4df0464d9e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.407486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029ab04-1f97-4d58-b430-6e4df0464d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.438014 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e029ab04-1f97-4d58-b430-6e4df0464d9e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:13.439266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e029ab04-1f97-4d58-b430-6e4df0464d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.481791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:13.484402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.533034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 945/1879] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:13.542266 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef009-92b8-4c7a-b977-9af17b9b1350 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.550717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef009-92b8-4c7a-b977-9af17b9b1350 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.551044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bef009-92b8-4c7a-b977-9af17b9b1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.618317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d8bef009-92b8-4c7a-b977-9af17b9b1350 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:13.619721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d8bef009-92b8-4c7a-b977-9af17b9b1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.635502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 946/1880] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:13.637055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cc56-65bb-4809-9c77-9cd683e2a26c None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.637315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cc56-65bb-4809-9c77-9cd683e2a26c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.637615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97cc56-65bb-4809-9c77-9cd683e2a26c None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.639525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 947/1881] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:45:13.642678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97cc56-65bb-4809-9c77-9cd683e2a26c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:13.665242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80990e84-dd6a-4ea7-bdd7-02307a1ef425 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:13.671797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:13.672940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.673416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.673784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97cc56-65bb-4809-9c77-9cd683e2a26c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:13.673985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] PATH_INFO: `/v3/projects/b42604f51f6843a1a0501a33a4ca927c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.675712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42604f51f6843a1a0501a33a4ca927c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:13.697607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:13.701935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:13.702629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.702918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.703200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.703982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:13.704295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:13.708288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6c127-9ab9-41f2-abcb-5984ee50ab88 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:13.735920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 948/1882] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:13.737445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616759d-9403-428c-89ee-6a5888aacb55 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.737747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616759d-9403-428c-89ee-6a5888aacb55 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.738036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616759d-9403-428c-89ee-6a5888aacb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.780411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5616759d-9403-428c-89ee-6a5888aacb55 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:13.781668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5616759d-9403-428c-89ee-6a5888aacb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.782616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42604f51f6843a1a0501a33a4ca927c', 'request_id': 'req-66af095e-ba57-450b-ab0f-727e7b564030'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.791415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42604f51f6843a1a0501a33a4ca927c', 'request_id': 'req-66af095e-ba57-450b-ab0f-727e7b564030'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.802704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42604f51f6843a1a0501a33a4ca927c', 'request_id': 'req-66af095e-ba57-450b-ab0f-727e7b564030'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.816424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] The token cache is being invalidate because project b42604f51f6843a1a0501a33a4ca927c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:13.816860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.817763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:13.823727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 935/1883] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:13 2022] DELETE /identity/v3/projects/b42604f51f6843a1a0501a33a4ca927c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:13.823727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:13.825207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.959820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 949/1884] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:13.962630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:13.963074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:13.963757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:13.985393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:13.986716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:13.997269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 950/1885] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:13.998352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.000471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.014272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af095e-ba57-450b-ab0f-727e7b564030 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.016113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33033d5-c540-461b-bd56-9873695e4828 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.024325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.030153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.030557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.030999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.031400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.031512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.032017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.032457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] PATH_INFO: `/v3/projects/51d7563e08bc47c3b4a4a75eba8146da` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.032825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.034162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d7563e08bc47c3b4a4a75eba8146da)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.036885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.038813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e948d3-b85c-4b26-bb39-9c5adc8f785b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.084844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 936/1886] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:13 2022] POST /identity/v3/projects => generated 399 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:14.087641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.088653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.089234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.115550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:14.117958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.121864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d7563e08bc47c3b4a4a75eba8146da', 'request_id': 'req-ac24e42d-b544-486c-9b58-c1b4886ab9bc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.134274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d7563e08bc47c3b4a4a75eba8146da', 'request_id': 'req-ac24e42d-b544-486c-9b58-c1b4886ab9bc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.141884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d7563e08bc47c3b4a4a75eba8146da', 'request_id': 'req-ac24e42d-b544-486c-9b58-c1b4886ab9bc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.153487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] The token cache is being invalidate because project 51d7563e08bc47c3b4a4a75eba8146da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:14.153795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.154507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.158891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 951/1887] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:13 2022] DELETE /identity/v3/projects/51d7563e08bc47c3b4a4a75eba8146da => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:14.159306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.161860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.219394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 937/1888] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:14.220383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.221979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.271646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24e42d-b544-486c-9b58-c1b4886ab9bc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.278107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.278813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.279169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.279399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.280118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.282058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.310444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 952/1889] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:14 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:14.310444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.312594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.329397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63adab3-ebd7-452e-b447-5d881904f3cc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.336869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e3ec-fb30-4675-bcff-10e099b9b1d2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.346342 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.347043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.347334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.347706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.350557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.352113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.352413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.352816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.353209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] PATH_INFO: `/v3/users/31bf5bb57e4540e0bd27ec6b52306ca0` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.355579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bf5bb57e4540e0bd27ec6b52306ca0)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.365515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.369952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.372165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.391910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 938/1890] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:14.392761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.406362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46e5d-7a0a-49f0-b94d-dc2bbc6ad470 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.414063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.414824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.415519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.415519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.416722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:14.418548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.419075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.438314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 939/1891] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:14.440398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.454287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea3cd3-71ad-4d9c-9db5-e5dff4f23214 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.456957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bf5bb57e4540e0bd27ec6b52306ca0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.458876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bf5bb57e4540e0bd27ec6b52306ca0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.462470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.463283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.463856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.464327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.465442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.467974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.484658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 940/1892] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:14.485571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.488475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.498956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bf5bb57e4540e0bd27ec6b52306ca0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.499721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bf5bb57e4540e0bd27ec6b52306ca0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.509671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761c473-223b-4175-87ce-ac64d34ae709 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.515044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bf5bb57e4540e0bd27ec6b52306ca0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:14.531095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.534047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.534465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.534913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.535869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.539550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.543320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 953/1893] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:14 2022] DELETE /identity/v3/users/31bf5bb57e4540e0bd27ec6b52306ca0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:14.543320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.543949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:14.577194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 941/1894] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:14 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:14.583392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.689577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0aee8-d49c-487b-b69b-5934eeeb9449 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.694537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658e23c-363b-4ed1-83b7-60eaee955166 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.702282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.703102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.703268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.704322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.706540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.707623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.709866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.710767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.711100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.711357 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.712143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.714348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.731607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 954/1895] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:14.737465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.743812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 942/1896] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:14 2022] POST /identity/v3/users => generated 282 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:14.749202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.756399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93152f0-7e1f-47e5-a95d-8b76a82d1a1f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.762222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c3008-16ab-4cfd-b581-90e0b01ab7a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.762775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.764296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.764780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.766689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] PATH_INFO: `/v3/projects/d15b45009883457bbb68fb44cc884813/users/c77ceadf54fa474e956f38f947fe2930/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.768057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.769013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.769358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.769736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.770650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.772479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.784065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 943/1897] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:14.788033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.794362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15b45009883457bbb68fb44cc884813, user_id=c77ceadf54fa474e956f38f947fe2930, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.799403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a90a4-ce7e-42c2-acdc-7d41c2ccd377 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.799897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08111a86-fe70-413b-a567-a2eb604443cf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.806615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:14.807540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.807846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.808179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.809133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:14.813576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:14.843616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 955/1898] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:14 2022] PUT /identity/v3/projects/d15b45009883457bbb68fb44cc884813/users/c77ceadf54fa474e956f38f947fe2930/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:14.847971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:14.847971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:14.850320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:14.863715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 944/1899] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:14.869019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:14.885354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457f1cd-c5de-42b3-93e1-59b51cf248d4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:14.932719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] MFA Rules not processed for user `c77ceadf54fa474e956f38f947fe2930`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:14.933818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:15.028555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.030838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.031280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.031962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] PATH_INFO: `/v3/projects/859330c2cd634e2194ad8626d4ace43e/users/b109ee07ca9a4a4788ccea699ae44109/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.053147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859330c2cd634e2194ad8626d4ace43e, user_id=b109ee07ca9a4a4788ccea699ae44109, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.056182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e4e87-0b45-4e79-82c5-7c3b1c8389b0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.087304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 945/1900] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:14 2022] PUT /identity/v3/projects/859330c2cd634e2194ad8626d4ace43e/users/b109ee07ca9a4a4788ccea699ae44109/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:15.089159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.089569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.090299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.113962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 956/1901] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:15.119144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.126261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] MFA Rules not processed for user `b109ee07ca9a4a4788ccea699ae44109`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:15.127952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:15.140182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13248-85e6-46a0-b8cb-9c9a7c397edc None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.249716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 946/1902] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:15.254549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.291869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.292579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.292871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.293149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.293909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.296117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.367749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 957/1903] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:15 2022] POST /identity/v3/projects => generated 401 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:15.371974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.423039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da3fc5-1c5f-42e5-9c4e-c4fbde1e5fc0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.543129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.544041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.544437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.544845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.545739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.547832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.565943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114faa85-caae-4996-9cab-d5d52eb84451 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.580216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.582319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.583590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.584906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.586388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.594716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 947/1904] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:15 2022] POST /identity/v3/projects => generated 363 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:15.597389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.597656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.639153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 958/1905] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:15 2022] POST /identity/v3/users => generated 307 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:15.643089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.663067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1f9e-1d35-438d-b57d-1cd39fef6b4d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.725244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00268d9-1539-413a-b569-651b17527800 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.731551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.732353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.732721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.733792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.733792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.735945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.784466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.785169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.785461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.785742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.786498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.786874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 948/1906] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:15 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:15.791418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.791743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.809565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 959/1907] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:15.813856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f44b1a-2778-4c45-98f5-cfa80c4ad411 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.813953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.820898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.821753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.822056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.822375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.825133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.827759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.837835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024aa003-f423-44cf-928e-94a1d50ba531 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.847771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 949/1908] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:15.850306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.851987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.852279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.852786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.852882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] PATH_INFO: `/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd/users/2d4a0a25f0664c3fb5b8c375f8684d59/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.875712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a47f0-2481-4603-b5ae-25d25968fb6b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:15.886570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:15.887863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:15.888249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:15.888577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] PATH_INFO: `/v3/projects/db2c02217c604fdcb8395784fea8ffe5/users/85654760b0214a0782623c7b257f493e/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:15.890275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec4ee72f11d4b3fb921c795be54e3fd, user_id=2d4a0a25f0664c3fb5b8c375f8684d59, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.894417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.916028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2c02217c604fdcb8395784fea8ffe5, user_id=85654760b0214a0782623c7b257f493e, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:15.918837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:15.934418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 960/1909] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:15 2022] PUT /identity/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd/users/2d4a0a25f0664c3fb5b8c375f8684d59/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:15.936084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:15.957535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 950/1910] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:15 2022] PUT /identity/v3/projects/db2c02217c604fdcb8395784fea8ffe5/users/85654760b0214a0782623c7b257f493e/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:15.963324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.095506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236229-2d66-4976-95a6-56fb072e4311 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.157008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327cd8-734c-4f3e-a407-77b03fdd0de4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.180694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.182079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.184074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.185073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.188781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.196371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.214063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 951/1911] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:16.216003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.218099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.220209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.221801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.222523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.223437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.225161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.229827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.239056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30e7c-9be7-4944-9ee9-54e45b4a506e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.247981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.249273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.249679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.250066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] PATH_INFO: `/v3/projects/c2f517ed65594713ad605736fd204566` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.251781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f517ed65594713ad605736fd204566)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.254585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.257126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 961/1912] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:16.259495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.286968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919172dc-92fa-41f1-ad10-9871b718b184 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.301966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.305597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.306352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.306792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] PATH_INFO: `/v3/projects/db2c02217c604fdcb8395784fea8ffe5/users/85654760b0214a0782623c7b257f493e/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.312153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2c02217c604fdcb8395784fea8ffe5, user_id=85654760b0214a0782623c7b257f493e, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.319385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.329022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f517ed65594713ad605736fd204566', 'request_id': 'req-f4590517-547b-444b-9080-0e9139b069fa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.339876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 962/1913] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:16 2022] PUT /identity/v3/projects/db2c02217c604fdcb8395784fea8ffe5/users/85654760b0214a0782623c7b257f493e/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:16.340693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.345700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f517ed65594713ad605736fd204566', 'request_id': 'req-f4590517-547b-444b-9080-0e9139b069fa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.356498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f517ed65594713ad605736fd204566', 'request_id': 'req-f4590517-547b-444b-9080-0e9139b069fa'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.396605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] The token cache is being invalidate because project c2f517ed65594713ad605736fd204566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:16.399337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.401072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4590517-547b-444b-9080-0e9139b069fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.407658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 952/1914] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:16 2022] DELETE /identity/v3/projects/c2f517ed65594713ad605736fd204566 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:16.412103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681913-d259-4d05-acfa-1682b379f0ec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.413271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681913-d259-4d05-acfa-1682b379f0ec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.416297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681913-d259-4d05-acfa-1682b379f0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.496039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fb88a-2e2c-4d7e-a42d-78c3a64a446a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.497880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0b681913-d259-4d05-acfa-1682b379f0ec None None] MFA Rules not processed for user `85654760b0214a0782623c7b257f493e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:16.500945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0b681913-d259-4d05-acfa-1682b379f0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.513913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.516048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.516378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.516612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] PATH_INFO: `/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd/users/2d4a0a25f0664c3fb5b8c375f8684d59/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.520199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec4ee72f11d4b3fb921c795be54e3fd, user_id=2d4a0a25f0664c3fb5b8c375f8684d59, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.535294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.563601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 963/1915] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:16 2022] PUT /identity/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd/users/2d4a0a25f0664c3fb5b8c375f8684d59/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:16.568409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.576298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.661929 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 953/1916] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:16.665783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.665979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.666260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.718611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] MFA Rules not processed for user `2d4a0a25f0664c3fb5b8c375f8684d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:16.720156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fc0b7-40d8-4241-9cb7-73d1c8b53574 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:16.724158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.732663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:16.734247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:16.734696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:16.735125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] PATH_INFO: `/v3/users/04a35504e1a049f89851316b299c7f58` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:16.737273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a35504e1a049f89851316b299c7f58)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:16.740005 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:16.869526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a35504e1a049f89851316b299c7f58'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.871019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 954/1917] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:16.871687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a35504e1a049f89851316b299c7f58'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.872775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.876515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.904626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a35504e1a049f89851316b299c7f58'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.906984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a35504e1a049f89851316b299c7f58'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.923618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a35504e1a049f89851316b299c7f58'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:16.948791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 964/1918] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:16 2022] DELETE /identity/v3/users/04a35504e1a049f89851316b299c7f58 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:16.949780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:16.951530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:16.989812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf7c02-9c64-40e8-a564-59e6d83ed199 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:17.038973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ac3c7-ed2b-41ab-acef-e30cc67c8297 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:17.063789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:17.066128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:17.067298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:17.067748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:17.078588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:17.104398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:17.106181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:17.106967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:17.108586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:17.112646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:17.228148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:17.229679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:17.248401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 965/1919] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:17.278292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:17.281705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:17.302363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 955/1920] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:17.357304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:17.379687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2e452-46bf-43cb-96d3-50097b643153 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:17.391752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:17.392590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:17.392949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:17.393386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:17.396327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:17.465474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:17.468317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:17.486664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19479dfd-4849-4236-9b0c-1c4d3bd017e6 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:17.495218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:17.496038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:17.496402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:17.496768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:17.501403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:17.573487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:17.576255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:17.611209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 966/1921] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:17.663883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:17.668630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63487d8-fd4d-4444-ae66-64fb6cdb736a service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:17.697533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 956/1922] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:18.254281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:18.255833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:18.366606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1d571-e8a8-4299-9b61-552db69a4fab service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:18.371801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:18.372683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.373099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.373382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] PATH_INFO: `/v3/projects/4f597916bb67441e9dde61b1b5c2afc5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.374845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f597916bb67441e9dde61b1b5c2afc5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:18.377167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:18.460138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f597916bb67441e9dde61b1b5c2afc5', 'request_id': 'req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:18.470117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f597916bb67441e9dde61b1b5c2afc5', 'request_id': 'req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:18.479384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f597916bb67441e9dde61b1b5c2afc5', 'request_id': 'req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:18.497562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] The token cache is being invalidate because project 4f597916bb67441e9dde61b1b5c2afc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:18.497562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:18.498275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ce46eb9e-65cf-4e5e-b82a-f1a6c06b50f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:18.500492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 967/1923] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:18 2022] DELETE /identity/v3/projects/4f597916bb67441e9dde61b1b5c2afc5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:18.506288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.506779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.506906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.536972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:18.538329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:18.643221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 957/1924] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:18.645378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.645675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.645960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.689111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:18.690418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:18.713558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 968/1925] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:18.715027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:18.729027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aac098-a0be-49dc-ae4b-a445a26f11bd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:18.736957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:18.738015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.738015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.751644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.752566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:18.752896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:18.754675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:18.777787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 958/1926] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:18.782384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:18.794567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945678fd-bbe4-47f3-bbb0-1c540a62d3f5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:18.803172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:18.805316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.806409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.806791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.808081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:18.810258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:18.852771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 969/1927] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:18 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:18.875169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:18.893799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90714a49-ff76-4e81-87c3-28ad8254bfa6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:18.994171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:18.994457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:18.994716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:18.995047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:18.995785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:18.997833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.024985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 959/1928] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:18 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:19.030379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.063252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a1b7-752f-4659-a818-57beacf331cb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.084071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.084591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.084881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.085158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.086932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.088641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.121619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.123008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 970/1929] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:19.141729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a58df-cedf-4288-86db-1443121bab47 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.157633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.159542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.159859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.160148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.160909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.162558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ca602-8029-43f9-87e5-9f82c5e525c7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.181498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 960/1930] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:19.182457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.194227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5008a32-5e35-4a55-8735-79b752a29870 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.201098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.202401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.202688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.203287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] PATH_INFO: `/v3/projects/12474ee1b75843579beb208a0136fe64/users/9f09223f4a2d412392cf09e78c9210ea/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.230092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=12474ee1b75843579beb208a0136fe64, user_id=9f09223f4a2d412392cf09e78c9210ea, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.233785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.278130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 971/1931] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:19 2022] PUT /identity/v3/projects/12474ee1b75843579beb208a0136fe64/users/9f09223f4a2d412392cf09e78c9210ea/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:19.280084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.280491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.280837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.359880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] MFA Rules not processed for user `9f09223f4a2d412392cf09e78c9210ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:19.372320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:19.596780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 961/1932] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:19.601881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.685168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865affd7-906e-453c-ad32-8a4efa55fefc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.689964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.690717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.691090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.691494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.692272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.694261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.728912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 972/1933] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:19 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:19.732887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.745135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90426bf1-ad47-47ae-9594-a6c41f57b70d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.810401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.811042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.811424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.811769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.812754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.814783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.854926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 962/1934] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:19 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:19.856421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.873346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b9e43-7bba-467c-87d2-730f62a41657 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.879172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.879949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.880240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.880520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.881255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.883758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.896139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 973/1935] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:19.900303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.910293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa293c-2dcc-46d2-95c2-0352ba22a8a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:19.915714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:19.916607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:19.916894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:19.917170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] PATH_INFO: `/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1/users/46629d64b0704e0c984788971138db03/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:19.933938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2bd6601ef1444ca16f77cb573b15d1, user_id=46629d64b0704e0c984788971138db03, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:19.936809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:19.951247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 963/1936] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:19 2022] PUT /identity/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1/users/46629d64b0704e0c984788971138db03/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:19.955357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:19.967670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c4a1-1633-4c44-bf7d-4adbc65df459 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:20.046134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:20.046835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:20.047127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:20.047458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:20.048585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:20.049875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a080800-65cc-440a-b3de-aff857ee178f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:20.066867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 974/1937] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:20.068496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:20.082765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b734c-afde-40f7-9359-1dc1e9b13c65 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:20.107881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:20.108932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:20.109297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:20.109659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] PATH_INFO: `/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1/users/46629d64b0704e0c984788971138db03/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:20.116090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2bd6601ef1444ca16f77cb573b15d1, user_id=46629d64b0704e0c984788971138db03, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:20.123090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:20.154217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 964/1938] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:20 2022] PUT /identity/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1/users/46629d64b0704e0c984788971138db03/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:20.164496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:20.164822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:20.165058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:20.221494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] MFA Rules not processed for user `46629d64b0704e0c984788971138db03`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:20.222892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:20.316596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 975/1939] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:20.325204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:20.327403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:20.423775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6825c-e4c2-49e9-ab94-1f3f6aa37354 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:20.436407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:20.436407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:20.436407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:20.436407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:20.452088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:20.453853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:20.466629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 965/1940] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:20.580001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:20.596032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a062-0394-493e-a72c-e8b427b5177c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:20.603924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:20.605552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:20.606053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:20.607241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:20.708435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:20.710555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beae5cb-09ea-45c1-8a78-0f2b7abb874b service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:20.723118 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 976/1941] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:28.446931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:28.449047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:28.549061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f68ec9-0899-4bdd-bd52-2eb57412a42a service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:28.559512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:28.560404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:28.560686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:28.560963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] PATH_INFO: `/v3/users/c77ceadf54fa474e956f38f947fe2930` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:28.562221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77ceadf54fa474e956f38f947fe2930)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:28.564218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:28.614697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77ceadf54fa474e956f38f947fe2930'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:28.622495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77ceadf54fa474e956f38f947fe2930'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:28.634778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77ceadf54fa474e956f38f947fe2930'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:28.635709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77ceadf54fa474e956f38f947fe2930'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:28.636255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77ceadf54fa474e956f38f947fe2930'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:28.650272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 966/1942] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:28 2022] DELETE /identity/v3/users/c77ceadf54fa474e956f38f947fe2930 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:28.654791 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:28.655273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:28.655374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:28.676716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:28.677943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:28.741976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 977/1943] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:28.759271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:28.762142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:28.845913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d185-5a3c-4c98-81c0-30c5ea074ba0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:28.849902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:28.851185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:28.851800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:28.852085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:28.862236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:28.863760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527293b6-51dc-45f1-b5b5-155fe32962c7 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:28.874803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 967/1944] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:29.092236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:29.094718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:29.110117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edb2e1-9f01-467a-8a87-23c3111e5584 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:29.119552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:29.120717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:29.121263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:29.122314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] PATH_INFO: `/v3/users/9f09223f4a2d412392cf09e78c9210ea` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:29.124214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f09223f4a2d412392cf09e78c9210ea)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:29.127247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:29.219463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f09223f4a2d412392cf09e78c9210ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:29.220867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f09223f4a2d412392cf09e78c9210ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:29.263162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f09223f4a2d412392cf09e78c9210ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:29.285619 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f09223f4a2d412392cf09e78c9210ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:29.307482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f09223f4a2d412392cf09e78c9210ea'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:29.344005 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 978/1945] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:29 2022] DELETE /identity/v3/users/9f09223f4a2d412392cf09e78c9210ea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:29.345770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:29.346071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:29.346459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:29.374610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:29.375863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:29.534563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 968/1946] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:29.593523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:29.596244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:29.726689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc320-e4da-4279-a253-25d7984b52e4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:29.763248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:29.764580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:29.765022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:29.765476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:29.785833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:29.789807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:29.841168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 979/1947] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:30.086860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:30.088371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:30.108827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c141973-f2b1-47d6-9bb8-38b73e0c2ece None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:30.131008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:30.132969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:30.133481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:30.134011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] PATH_INFO: `/v3/projects/d15b45009883457bbb68fb44cc884813` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:30.135847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15b45009883457bbb68fb44cc884813)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:30.138579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:30.227721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15b45009883457bbb68fb44cc884813', 'request_id': 'req-30835fcf-a431-4926-8e5e-d6210cc2b202'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.239606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15b45009883457bbb68fb44cc884813', 'request_id': 'req-30835fcf-a431-4926-8e5e-d6210cc2b202'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.255565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15b45009883457bbb68fb44cc884813', 'request_id': 'req-30835fcf-a431-4926-8e5e-d6210cc2b202'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.275786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] The token cache is being invalidate because project d15b45009883457bbb68fb44cc884813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:30.276013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.276662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.283017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:30.283539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 969/1948] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:30 2022] DELETE /identity/v3/projects/d15b45009883457bbb68fb44cc884813 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:30.297208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dcd8d-c975-46f0-b90f-b9303442eb5a service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:30.418718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:30.419846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:30.420230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:30.420676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] PATH_INFO: `/v3/users/2d4a0a25f0664c3fb5b8c375f8684d59` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:30.422870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4a0a25f0664c3fb5b8c375f8684d59)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:30.428055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:30.524121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4a0a25f0664c3fb5b8c375f8684d59'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.525876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4a0a25f0664c3fb5b8c375f8684d59'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.571617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4a0a25f0664c3fb5b8c375f8684d59'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.578458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4a0a25f0664c3fb5b8c375f8684d59'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.589817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4a0a25f0664c3fb5b8c375f8684d59'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.605446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 980/1949] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:30 2022] DELETE /identity/v3/users/2d4a0a25f0664c3fb5b8c375f8684d59 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:30.789114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:30.790588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:30.820495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835fcf-a431-4926-8e5e-d6210cc2b202 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:30.892840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:30.893771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:30.894226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:30.894521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] PATH_INFO: `/v3/projects/12474ee1b75843579beb208a0136fe64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:30.895882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12474ee1b75843579beb208a0136fe64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:30.898053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:30.976973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12474ee1b75843579beb208a0136fe64', 'request_id': 'req-1f508a8d-10f2-4bbf-ae47-f886497cc358'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.984714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12474ee1b75843579beb208a0136fe64', 'request_id': 'req-1f508a8d-10f2-4bbf-ae47-f886497cc358'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.995651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12474ee1b75843579beb208a0136fe64', 'request_id': 'req-1f508a8d-10f2-4bbf-ae47-f886497cc358'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:30.997590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:30.999048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.014068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22653c0d-05c0-4da3-aab0-262f9b3c3b39 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.028909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] The token cache is being invalidate because project 12474ee1b75843579beb208a0136fe64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:31.029335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.030183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.032244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 970/1950] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:30 2022] DELETE /identity/v3/projects/12474ee1b75843579beb208a0136fe64 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:31.039885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.042069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.093395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.094692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.095235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.095794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] PATH_INFO: `/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.097346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec4ee72f11d4b3fb921c795be54e3fd)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.099614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.144730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508a8d-10f2-4bbf-ae47-f886497cc358 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.150632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.151598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.151893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.152492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] PATH_INFO: `/v3/users/46629d64b0704e0c984788971138db03` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.153561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] RBAC: Authorizing `identity:delete_user(user_id=46629d64b0704e0c984788971138db03)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.155764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.169031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec4ee72f11d4b3fb921c795be54e3fd', 'request_id': 'req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.178635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec4ee72f11d4b3fb921c795be54e3fd', 'request_id': 'req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.187641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec4ee72f11d4b3fb921c795be54e3fd', 'request_id': 'req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.201988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] The token cache is being invalidate because project bec4ee72f11d4b3fb921c795be54e3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:31.202659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.204082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5483c9bf-1f21-4bfb-bd07-7cea5cdee47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.206924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 981/1951] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:30 2022] DELETE /identity/v3/projects/bec4ee72f11d4b3fb921c795be54e3fd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:31.215552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.216104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.216600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.229249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46629d64b0704e0c984788971138db03'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.237405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:31.237604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46629d64b0704e0c984788971138db03'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.238965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.258111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46629d64b0704e0c984788971138db03'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.259427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46629d64b0704e0c984788971138db03'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.260479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de83fa6f-f2cf-46af-bbdb-42602095952f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46629d64b0704e0c984788971138db03'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.279839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 971/1952] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:31 2022] DELETE /identity/v3/users/46629d64b0704e0c984788971138db03 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:31.313859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 982/1953] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:31.325148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.325597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.326115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.346816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:31.348191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.423621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 972/1954] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:31.428032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.450548 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a499f7-e35a-4b98-9285-9cffc9cfad42 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.467733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.468628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.469317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.469703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.471153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:31.471639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.473741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.499747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 983/1955] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:31.504569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.523589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bbfa1-9abb-4bdf-90ed-849463092ef5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.532330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.533708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.533708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.533708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.534741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.536937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.597900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 973/1956] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:31 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:31.602809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.621482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbc618-0f74-4300-acb1-18c1fc4abb9d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.650426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.652295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.761012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.763105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.763507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.763726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.764627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.766847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.779674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3554a4-97dc-4a51-bbfa-0018debb7503 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.787852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.790391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.791093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.791187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] PATH_INFO: `/v3/users/b109ee07ca9a4a4788ccea699ae44109` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.793823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b109ee07ca9a4a4788ccea699ae44109)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.797026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.809474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 984/1957] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:31 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:31.809474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.809474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.832776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c2467-ab04-45f4-9ab7-8c675bcd3c7c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:31.842467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:31.843478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:31.843798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:31.844627 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] PATH_INFO: `/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:31.869249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2bd6601ef1444ca16f77cb573b15d1)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:31.869249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:31.896977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b109ee07ca9a4a4788ccea699ae44109'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.912043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b109ee07ca9a4a4788ccea699ae44109'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.932170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b109ee07ca9a4a4788ccea699ae44109'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.933042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b109ee07ca9a4a4788ccea699ae44109'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.933783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b109ee07ca9a4a4788ccea699ae44109'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.956843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 974/1958] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:31 2022] DELETE /identity/v3/users/b109ee07ca9a4a4788ccea699ae44109 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:31.956843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:31.958715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:31.966567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2bd6601ef1444ca16f77cb573b15d1', 'request_id': 'req-00eb02e1-278b-4b77-98f1-12d8c0a80c73'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.980045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2bd6601ef1444ca16f77cb573b15d1', 'request_id': 'req-00eb02e1-278b-4b77-98f1-12d8c0a80c73'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:31.990645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2bd6601ef1444ca16f77cb573b15d1', 'request_id': 'req-00eb02e1-278b-4b77-98f1-12d8c0a80c73'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:32.010227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] The token cache is being invalidate because project 7c2bd6601ef1444ca16f77cb573b15d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:32.011520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:32.012405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00eb02e1-278b-4b77-98f1-12d8c0a80c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:32.014883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 985/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:31 2022] DELETE /identity/v3/projects/7c2bd6601ef1444ca16f77cb573b15d1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:32.017530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.018129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.018577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.051393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:32.054783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.072402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdddd8-e6eb-4b73-8c9c-8599378cd606 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.077891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.078610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.079059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.079167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.079945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.083073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657bc83-ac76-4d66-9645-e2f701eba754 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.092834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 975/1960] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:32.094179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335e8e-e097-4cae-bdba-ea505c2185c2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.094456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335e8e-e097-4cae-bdba-ea505c2185c2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.094735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335e8e-e097-4cae-bdba-ea505c2185c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.116861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f7335e8e-e097-4cae-bdba-ea505c2185c2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:32.118347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f7335e8e-e097-4cae-bdba-ea505c2185c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.125240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 986/1961] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:32.126035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.126703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 976/1962] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:32.127926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.135151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.135493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.135784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.143503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1161-5dd1-4ba4-8a6e-c2e99823065d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.148456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.149146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.149429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.149706 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.150446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.152105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.155228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:32.156557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.166056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 987/1963] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:32.166056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.166056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.173069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 977/1964] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:32.173069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.182658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a98ab4-a650-40be-bf43-8e4307b7bd51 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.187580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.188706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.189001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.189288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] PATH_INFO: `/v3/projects/37392e80feea490886351ac375315eef/users/00abd55c438d40e2a2e709f4ad215cbc/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.207936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37392e80feea490886351ac375315eef, user_id=00abd55c438d40e2a2e709f4ad215cbc, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.211689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.229498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 978/1965] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:32 2022] PUT /identity/v3/projects/37392e80feea490886351ac375315eef/users/00abd55c438d40e2a2e709f4ad215cbc/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:32.230551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.274361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fbbad-3f52-462b-b85e-e4fe699c87ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.312618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac47385-e737-40a6-92e6-32f0e3371293 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.318224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.319016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.319993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.321323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.322106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:32.322430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.324177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccfa6f-29c4-41e2-9d1b-928c35dd4a4b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.342508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 979/1966] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:32.342508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.342508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.342508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.343878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.344890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.345218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.345473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.359258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.360621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:32.360769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.362330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.372108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 980/1967] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:32.381157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 988/1968] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:32.383469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.384881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.386540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.395150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcebe45-d58d-403b-9709-6ea96dbe1aad None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.400385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311b11-8c84-410d-8934-782c03035a0c service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.401819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.402502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.402790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.403159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.403983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.405413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.406201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.406324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.406753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.407131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.424401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.426052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.438081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 989/1969] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:32.442171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 981/1970] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/projects => generated 359 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:32.448540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.460085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064878-43e1-451a-924a-f4231111a376 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.541757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.543240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.543730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.544125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.544848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.547400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.572912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 990/1971] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:32.576933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.588677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1855-fe9a-4145-92f2-094403ceaf84 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.607871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.608574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.608867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.609150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.609940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.611630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.624436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 982/1972] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:32.628809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.640752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e3c9-be50-45ab-9270-22daf5cbe9a2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.646121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.646813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.647130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.647559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.648458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.650122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34bc3-b429-4d65-ab3a-4d3c3ec889c5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.662622 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 991/1973] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:32.666673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.677591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600c693-4977-45b1-af9d-0b03bac7969d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.682752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.683703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.684125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.684264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] PATH_INFO: `/v3/projects/cf7bf1e940584ea6ad9ec8a61a26d420/users/90cee6357dc54b64885b75c33c390194/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.700512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7bf1e940584ea6ad9ec8a61a26d420, user_id=90cee6357dc54b64885b75c33c390194, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:32.703309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:32.717628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 983/1974] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:32 2022] PUT /identity/v3/projects/cf7bf1e940584ea6ad9ec8a61a26d420/users/90cee6357dc54b64885b75c33c390194/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:32.728720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.729019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.729298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:32.758549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] MFA Rules not processed for user `90cee6357dc54b64885b75c33c390194`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:32.759794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.824855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.827679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.865445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 992/1975] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:32 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:32.910534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:32.913712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:32.989098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d682d-92a0-4b8e-a5b1-94ea429e2cc6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:32.993477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:32.994939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:32.995904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:32.995904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.006405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.008278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.011981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea01d7-45ea-47b3-bddf-3b4c06c0040a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.018139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.019158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.019555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.019909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] PATH_INFO: `/v3/projects/859330c2cd634e2194ad8626d4ace43e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.021295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=859330c2cd634e2194ad8626d4ace43e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.023936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.042197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 993/1976] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:32 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:33.058276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.075541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22594a5-181f-468a-b879-549fb9f41148 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.087860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859330c2cd634e2194ad8626d4ace43e', 'request_id': 'req-50df4452-6146-4c23-a65b-c411feaff43a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.100531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859330c2cd634e2194ad8626d4ace43e', 'request_id': 'req-50df4452-6146-4c23-a65b-c411feaff43a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.109484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859330c2cd634e2194ad8626d4ace43e', 'request_id': 'req-50df4452-6146-4c23-a65b-c411feaff43a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.123528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] The token cache is being invalidate because project 859330c2cd634e2194ad8626d4ace43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:33.123819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.124594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.126270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 984/1977] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:32 2022] DELETE /identity/v3/projects/859330c2cd634e2194ad8626d4ace43e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:33.130541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.132838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.158514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.159421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.159740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.160027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] PATH_INFO: `/v3/users/90cee6357dc54b64885b75c33c390194` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.161255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cee6357dc54b64885b75c33c390194)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.163233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.209075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4452-6146-4c23-a65b-c411feaff43a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.214183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cee6357dc54b64885b75c33c390194'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.214934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cee6357dc54b64885b75c33c390194'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.215550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.216515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.216869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.217154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] PATH_INFO: `/v3/users/85654760b0214a0782623c7b257f493e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.219470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=85654760b0214a0782623c7b257f493e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.221843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.229330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cee6357dc54b64885b75c33c390194'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.231095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cee6357dc54b64885b75c33c390194'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.245758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e96659fc-26de-427e-8d46-1244e23c17b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cee6357dc54b64885b75c33c390194'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.283952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 994/1978] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:33 2022] DELETE /identity/v3/users/90cee6357dc54b64885b75c33c390194 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:33.286769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46751d3-e774-4baa-bd16-ceb08b8734cf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.287067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46751d3-e774-4baa-bd16-ceb08b8734cf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.287349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46751d3-e774-4baa-bd16-ceb08b8734cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.306282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d46751d3-e774-4baa-bd16-ceb08b8734cf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:33.306645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85654760b0214a0782623c7b257f493e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.307576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d46751d3-e774-4baa-bd16-ceb08b8734cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.316726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85654760b0214a0782623c7b257f493e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.333056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85654760b0214a0782623c7b257f493e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.336459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85654760b0214a0782623c7b257f493e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.336459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85654760b0214a0782623c7b257f493e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:33.350515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 985/1979] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:33 2022] DELETE /identity/v3/users/85654760b0214a0782623c7b257f493e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:33.382426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 995/1980] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:33.395042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.396582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.484866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a0d5-d641-4fe6-adb8-50ffdbec5aac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.490820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.491777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.492303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.492680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.667525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.669276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.687708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 986/1981] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:33.708068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.708068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.708375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.758952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] MFA Rules not processed for user `00abd55c438d40e2a2e709f4ad215cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:33.761092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.863238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.864716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.872487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 996/1982] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:33.875237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.877237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:33.879233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464617fe-f25e-45fe-8505-b03ceca194f9 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.890080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.890999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.891285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.891651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] PATH_INFO: `/v3/projects/db2c02217c604fdcb8395784fea8ffe5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.898162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2c02217c604fdcb8395784fea8ffe5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.904203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.907674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa106e7b-4464-4e87-a372-9b05042a3745 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:33.917356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:33.918090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:33.918484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:33.918652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:33.920279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:33.923399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:33.968973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 997/1983] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:33 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:33.970235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:33.998325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2c02217c604fdcb8395784fea8ffe5', 'request_id': 'req-e3d57d42-66d3-466f-b799-47f86b14a2ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.010106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2c02217c604fdcb8395784fea8ffe5', 'request_id': 'req-e3d57d42-66d3-466f-b799-47f86b14a2ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.026532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2c02217c604fdcb8395784fea8ffe5', 'request_id': 'req-e3d57d42-66d3-466f-b799-47f86b14a2ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.055967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] The token cache is being invalidate because project db2c02217c604fdcb8395784fea8ffe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:34.058038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.063900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e3d57d42-66d3-466f-b799-47f86b14a2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.070104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 987/1984] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:33 2022] DELETE /identity/v3/projects/db2c02217c604fdcb8395784fea8ffe5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:34.073197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3edb1-847e-4659-b093-1dab8a9c55e3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.073446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3edb1-847e-4659-b093-1dab8a9c55e3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.073561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3edb1-847e-4659-b093-1dab8a9c55e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.086443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655554-ae59-4b23-bfa5-92940df079f2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.105815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ebf3edb1-847e-4659-b093-1dab8a9c55e3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:34.107051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ebf3edb1-847e-4659-b093-1dab8a9c55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.192574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 988/1985] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:34.200895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.201480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.202034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.206554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.207253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.207575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.207937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.208642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.210784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.222052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:34.223632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.233916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 989/1986] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:34.236139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 998/1987] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:33 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:34.238787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.240222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.242871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.250592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0678560-9e54-4ed1-85a2-471878fe35fe None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.256099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1295a9-f3a7-4cd6-8e87-812663fe2e10 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.257295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.258043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.258376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.258687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.259505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:34.259819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.261565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.271282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.272574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.272574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.272922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.273892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.275679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.277788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 990/1988] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:34.283262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.285412 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.298662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 999/1989] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:34.298662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.308863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bb52d-167f-450a-890f-8a6aed916524 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.311085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8252d-0f05-4c75-b280-caa2fd5fd40f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.314298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.315552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.315879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.316323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.317221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.319971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.327468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.328675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.328963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.329243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] PATH_INFO: `/v3/projects/cf7bf1e940584ea6ad9ec8a61a26d420` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.330708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7bf1e940584ea6ad9ec8a61a26d420)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.332982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.354473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1000/1990] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:34.355451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.414642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7bf1e940584ea6ad9ec8a61a26d420', 'request_id': 'req-cd0d2bcd-636c-40c8-ad05-6819290545cd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.424860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7bf1e940584ea6ad9ec8a61a26d420', 'request_id': 'req-cd0d2bcd-636c-40c8-ad05-6819290545cd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.439472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7bf1e940584ea6ad9ec8a61a26d420', 'request_id': 'req-cd0d2bcd-636c-40c8-ad05-6819290545cd'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.449358 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe5988-fb8b-4e35-8ee5-afe66606b029 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.454711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] The token cache is being invalidate because project cf7bf1e940584ea6ad9ec8a61a26d420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:34.455163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.457085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:34.463476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 991/1991] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:34 2022] DELETE /identity/v3/projects/cf7bf1e940584ea6ad9ec8a61a26d420 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:34.465587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.467129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.528847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.530416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.530416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.530416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] PATH_INFO: `/v3/projects/ad54179601194a778b042b50c9b63ece/users/e44ad1af22f842a9ac320cf9edcc836e/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.550551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad54179601194a778b042b50c9b63ece, user_id=e44ad1af22f842a9ac320cf9edcc836e, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.554480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a94d7-1a3b-452d-a5c8-97caf623037f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.580574 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1001/1992] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:34 2022] PUT /identity/v3/projects/ad54179601194a778b042b50c9b63ece/users/e44ad1af22f842a9ac320cf9edcc836e/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:34.587050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.587393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.587813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.601537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d2bcd-636c-40c8-ad05-6819290545cd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.609600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:34.610886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.673270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.674127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.674333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.674612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.675322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.677399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db954e1-c6dc-4376-ab8f-bcf84ca2eaac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.686640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1002/1993] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:34.687915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.689414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.705718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387693-20ae-4fa7-9c37-36dbef26b3c4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.709442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 992/1994] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:34.713795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.714565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.714920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.715286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.715976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.715976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.716190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.716278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.718119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.731444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1003/1995] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:34.732407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.738257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:34.739544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:34.744893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128a7f-9868-4766-9ba8-20ccff37f452 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.751855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 993/1996] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:34.752082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.752265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.752391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.752391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.752391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.752391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.753732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.763533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56700d08-0d6c-4451-965d-2dbeb24383ba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.768527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.769597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.769956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.770313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] PATH_INFO: `/v3/projects/ad54179601194a778b042b50c9b63ece/users/e44ad1af22f842a9ac320cf9edcc836e/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.773206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad54179601194a778b042b50c9b63ece, user_id=e44ad1af22f842a9ac320cf9edcc836e, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.774410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1004/1997] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:34.775441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.776728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.786510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2863-c086-4eff-9f5b-e6785fa39192 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.791471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 994/1998] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:34 2022] PUT /identity/v3/projects/ad54179601194a778b042b50c9b63ece/users/e44ad1af22f842a9ac320cf9edcc836e/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:34.792651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.873149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.874183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.874764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.875283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.876296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:34.876778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.879430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.894897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1005/1999] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:34.900641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.922961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154195-68df-47a5-85df-60bda3445198 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.934535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.935506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.935941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.936325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.938170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841541b8-ad99-4f4a-8dea-e58c1bcaa6cc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.938708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.941404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.947893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:34.949008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:34.949526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:34.949824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:34.950725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:34.953830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:34.969797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 995/2000] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:34.976696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:34.990537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd452d-74aa-4f40-9321-86f73971aeae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:34.999868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1006/2001] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:34 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:35.000095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.000095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.000095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.000095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] PATH_INFO: `/v3/projects/e1f5c8c984124b9fb21e79fc96ca36f5/users/13031c81140d4366bf9bc7c4e36cdf53/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.003025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.024913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f5c8c984124b9fb21e79fc96ca36f5, user_id=13031c81140d4366bf9bc7c4e36cdf53, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.028420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835d449-0437-49e4-baa8-ef740775531c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.052949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 996/2002] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:34 2022] PUT /identity/v3/projects/e1f5c8c984124b9fb21e79fc96ca36f5/users/13031c81140d4366bf9bc7c4e36cdf53/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:35.064490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.064490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.064751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.104413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] MFA Rules not processed for user `13031c81140d4366bf9bc7c4e36cdf53`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:35.106064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:35.129441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2fe57-d790-4f16-908f-c7598cd8b9dc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.214649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 997/2003] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:35.215977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.216766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.218285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.220684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.220684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.224726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.232492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.237769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a183a2-88ff-4909-94e2-58b3ed9cc492 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.245035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.245723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.246004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.246281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.248087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.250244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.279050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1007/2004] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/users => generated 287 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:35.283356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.291421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 998/2005] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:35.293963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.294672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dfc87-d279-4a85-9bde-3c14834d64e7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.361910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.362846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.363204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.363739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.364718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.367566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.373141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8678c-fe59-48f4-b37f-1c18181bfc58 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.378094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.378858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.379394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.379616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.380371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.380995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1008/2006] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:35.383204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.386372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.396784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b5ab-3fb3-41cc-a828-45e185fdd604 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.403983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.404894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.406249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.406612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.407772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.409511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.413143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 999/2007] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:35.414925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.430656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d153ab8-18dc-47b9-b416-2ee25ccb2dd4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.431134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1009/2008] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:35.435259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.436098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.437006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.437389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.437759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.438584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.440466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.446622 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc644d75-f1bc-47ca-ae77-1db647e758a5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.452441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.453263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.453542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.454135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] PATH_INFO: `/v3/projects/361f3085fc8f4b8d97db73bd3fddaaff/users/227365c84bec4c5d9feadbda15158aff/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.458011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1000/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:35.458919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.472173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361f3085fc8f4b8d97db73bd3fddaaff, user_id=227365c84bec4c5d9feadbda15158aff, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.472362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9d420-3963-4959-827e-06e468a060c9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.475053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef541704-5740-4d77-b25e-155ae4af97f6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.479716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.481231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.482525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.483588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] PATH_INFO: `/v3/projects/370ce126852b40f88449170cbebd2941/users/19fceb9ff63040e18578d843302075c2/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.500439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1010/2010] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:35 2022] PUT /identity/v3/projects/361f3085fc8f4b8d97db73bd3fddaaff/users/227365c84bec4c5d9feadbda15158aff/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:35.505750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370ce126852b40f88449170cbebd2941, user_id=19fceb9ff63040e18578d843302075c2, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.510685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.510968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.511257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.513382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.533236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1001/2011] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:35 2022] PUT /identity/v3/projects/370ce126852b40f88449170cbebd2941/users/19fceb9ff63040e18578d843302075c2/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:35.537153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.544589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] MFA Rules not processed for user `227365c84bec4c5d9feadbda15158aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:35.546417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:35.631328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1011/2012] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:35.645498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.649099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:35.651662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f277f-dd95-4dfa-b7d6-53a6e4d37a10 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.657667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.658455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.658815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.659166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.660045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.661750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.674828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1002/2013] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:35.680210 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.693862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b04c-555d-4569-a635-a2a501cd1796 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.699808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.700795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.701200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.701545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] PATH_INFO: `/v3/projects/370ce126852b40f88449170cbebd2941/users/19fceb9ff63040e18578d843302075c2/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.703807 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=370ce126852b40f88449170cbebd2941, user_id=19fceb9ff63040e18578d843302075c2, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.706649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5d63f-21eb-42aa-9edb-24c667eda38d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.719155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1003/2014] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:35 2022] PUT /identity/v3/projects/370ce126852b40f88449170cbebd2941/users/19fceb9ff63040e18578d843302075c2/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:35.731017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.731330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.732039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.732650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7188aa-3cba-4ed1-8fd6-61936381385f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.761658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] MFA Rules not processed for user `19fceb9ff63040e18578d843302075c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:35.763191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:35.794765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.795472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.795755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.796032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.857965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1004/2015] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:35.870103 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.871825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:35.882304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.884021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.886663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34faac5-8a48-406a-9bbe-91e46b5d188c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.891596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.892492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.893578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.894022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:35.894147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1012/2016] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:35.906090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:35.907857 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a9100-38ab-4969-a887-27d031b4f6c5 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:35.920089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1005/2017] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:45:35.970712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:35.981279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a0321-dfd6-4739-befe-f911507d9bff service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:35.985366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:35.986246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:35.986606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:35.986962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:36.059693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:36.061279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:36.074021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:36.074601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:36.074696 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:36.082528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1013/2018] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:36.128986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] MFA Rules not processed for user `e44ad1af22f842a9ac320cf9edcc836e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:36.130756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:36.271798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1006/2019] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:36.536057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:36.547837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a174-fc17-4b9d-870b-b0effd9a2092 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:36.559669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:36.560412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:36.560714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:36.560998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:36.565617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:36.707528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:36.709038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:36.718774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1014/2020] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:38.149520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:38.167578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4aa14-970c-4199-b5d8-d2a2c5879a08 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:38.173998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:38.175343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:38.175965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:38.176493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:38.207136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:38.208837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:38.239804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1007/2021] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:39.668033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:39.791141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4776a-cd7e-45c4-bdb9-5db52ab64362 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:39.808524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:39.811843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:39.812462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:39.813240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] PATH_INFO: `/v3/users/227365c84bec4c5d9feadbda15158aff` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:39.814756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227365c84bec4c5d9feadbda15158aff)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:39.817397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:39.907006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227365c84bec4c5d9feadbda15158aff'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:39.907767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227365c84bec4c5d9feadbda15158aff'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:39.929715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227365c84bec4c5d9feadbda15158aff'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:39.930498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227365c84bec4c5d9feadbda15158aff'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:39.941512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-52307036-7ab2-4fa6-bb7b-752991c7dda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227365c84bec4c5d9feadbda15158aff'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:39.971572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:39.985095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1015/2022] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:39 2022] DELETE /identity/v3/users/227365c84bec4c5d9feadbda15158aff => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:39.989467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:39.989847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:39.990227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.008608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d7563-2307-4d59-a835-db2d52338920 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:40.017602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:40.019427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.110858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:40.112136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.112612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.113038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] PATH_INFO: `/v3/users/13031c81140d4366bf9bc7c4e36cdf53` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.114815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13031c81140d4366bf9bc7c4e36cdf53)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:40.117988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:40.127043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1016/2023] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:40.136224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:40.137527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.189755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13031c81140d4366bf9bc7c4e36cdf53'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.198022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13031c81140d4366bf9bc7c4e36cdf53'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.207527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bf7e3-8809-48b5-b5ff-f26f7500a525 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:40.211681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13031c81140d4366bf9bc7c4e36cdf53'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.211976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:40.213132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13031c81140d4366bf9bc7c4e36cdf53'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.213297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.213297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.213563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13031c81140d4366bf9bc7c4e36cdf53'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.213718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.215587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.230108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:40.231810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151768e-366d-4780-a59f-78a55cdb43a8 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:40.244319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1017/2024] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:40.247762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1008/2025] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:39 2022] DELETE /identity/v3/users/13031c81140d4366bf9bc7c4e36cdf53 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:40.252222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.252534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.253079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.274452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:40.282599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.379412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1018/2026] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:40.403823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:40.405281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.490762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1fe18-1afe-4c56-b404-269be2466205 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:40.495472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:40.496254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.496670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.496799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.518566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:40.521579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:40.536572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1009/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:40.773561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:40.776057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.804826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229c6-975c-4c72-8698-dcfeee600da5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:40.820849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:40.821812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.822103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.822376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] PATH_INFO: `/v3/projects/361f3085fc8f4b8d97db73bd3fddaaff` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:40.824213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361f3085fc8f4b8d97db73bd3fddaaff)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:40.828125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:40.911936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361f3085fc8f4b8d97db73bd3fddaaff', 'request_id': 'req-8bba886e-7641-4290-a63d-6d23a6858ba5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.930975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:40.932562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:40.932682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361f3085fc8f4b8d97db73bd3fddaaff', 'request_id': 'req-8bba886e-7641-4290-a63d-6d23a6858ba5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.942187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361f3085fc8f4b8d97db73bd3fddaaff', 'request_id': 'req-8bba886e-7641-4290-a63d-6d23a6858ba5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.953230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308b8f-fc39-4e8f-bd52-65aa73c13b29 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:40.972545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] The token cache is being invalidate because project 361f3085fc8f4b8d97db73bd3fddaaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:40.972934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.975996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8bba886e-7641-4290-a63d-6d23a6858ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:40.982876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1019/2028] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:40 2022] DELETE /identity/v3/projects/361f3085fc8f4b8d97db73bd3fddaaff => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:40.990601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ca-2e84-4497-bc62-5901477ea97c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:40.990601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ca-2e84-4497-bc62-5901477ea97c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:40.990601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c954ca-2e84-4497-bc62-5901477ea97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.022924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e1c954ca-2e84-4497-bc62-5901477ea97c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:41.025156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e1c954ca-2e84-4497-bc62-5901477ea97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:41.108604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.110898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.111668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.112106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] PATH_INFO: `/v3/projects/e1f5c8c984124b9fb21e79fc96ca36f5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.113858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f5c8c984124b9fb21e79fc96ca36f5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.116793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.190704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1020/2029] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:41.199830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.200317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.200786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.208023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f5c8c984124b9fb21e79fc96ca36f5', 'request_id': 'req-6f187957-78f7-41ca-b356-db32d8c6858a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.224319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f5c8c984124b9fb21e79fc96ca36f5', 'request_id': 'req-6f187957-78f7-41ca-b356-db32d8c6858a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.250386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f5c8c984124b9fb21e79fc96ca36f5', 'request_id': 'req-6f187957-78f7-41ca-b356-db32d8c6858a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.250812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:41.252355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:41.270428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] The token cache is being invalidate because project e1f5c8c984124b9fb21e79fc96ca36f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:41.271022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.271955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.277510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1010/2030] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:40 2022] DELETE /identity/v3/projects/e1f5c8c984124b9fb21e79fc96ca36f5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:41.290224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.292067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:41.347839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1021/2031] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:41.353352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.362933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58720aee-c4ca-418d-9ac2-123a189b03f8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.368893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.369605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.369895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.370179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.370934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:41.371248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.378143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.410898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1022/2032] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:45:41.412741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.420099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f187957-78f7-41ca-b356-db32d8c6858a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.425032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade765-7c71-4fd3-aeb2-ea89264024aa admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.426188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.426853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.427150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.427514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] PATH_INFO: `/v3/users/19fceb9ff63040e18578d843302075c2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.428866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fceb9ff63040e18578d843302075c2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.431874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.436632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.437264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.437562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.437842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.438558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.440858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.488082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1023/2033] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:41 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:41.490392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.500075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fceb9ff63040e18578d843302075c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.512678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fceb9ff63040e18578d843302075c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.529592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fceb9ff63040e18578d843302075c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.530525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fceb9ff63040e18578d843302075c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.531349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fceb9ff63040e18578d843302075c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:41.546520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1011/2034] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:41 2022] DELETE /identity/v3/users/19fceb9ff63040e18578d843302075c2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:41.640873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218142-a997-4473-949d-652a4bc0b4a2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.737778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.737778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.737778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.737778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.738479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.738479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.762983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1024/2035] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:41 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:41.767880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.769600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:41.789634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898883-99aa-423c-a187-465a184d9da5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.797599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.798340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.798690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.799035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.799763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.801479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.821062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1012/2036] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:41.822578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.841500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b2ad7-8180-4b72-9b73-287057a0e62f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.858571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.860218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.860704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.861158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.862148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.864129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8546d26-39aa-4565-84ab-5eaa3be48a8b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.881807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1025/2037] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:41.886079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:41.900471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973e5c5-958a-47a8-acb9-6e973d4260ce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:41.907927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:41.909650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.910085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.910510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] PATH_INFO: `/v3/projects/a9709ba15cbd43a1afdaf1d4985a9b63/users/9f97ffb4ad344d47b47474e9037b7ff3/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:41.931687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9709ba15cbd43a1afdaf1d4985a9b63, user_id=9f97ffb4ad344d47b47474e9037b7ff3, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:41.934480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:41.955436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1013/2038] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:41 2022] PUT /identity/v3/projects/a9709ba15cbd43a1afdaf1d4985a9b63/users/9f97ffb4ad344d47b47474e9037b7ff3/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:41.967687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:41.968133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:41.968664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.001310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] MFA Rules not processed for user `9f97ffb4ad344d47b47474e9037b7ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:42.002862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.013973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.016520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.094419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1026/2039] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:42.099351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.108560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8ffe1-03f9-497d-a576-5f9e0a67a179 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.113587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.114469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.114757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.115038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] PATH_INFO: `/v3/projects/370ce126852b40f88449170cbebd2941` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.116763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370ce126852b40f88449170cbebd2941)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.118707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.119937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56722e9e-98bb-4019-9228-e70f092d07e5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.124991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.125759 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.126054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.126337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.127046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.129101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.167422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1027/2040] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:42.168518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.183180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370ce126852b40f88449170cbebd2941', 'request_id': 'req-c1ff52f4-756e-4db3-b493-0bb4b168ad26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:42.200108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370ce126852b40f88449170cbebd2941', 'request_id': 'req-c1ff52f4-756e-4db3-b493-0bb4b168ad26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:42.213140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370ce126852b40f88449170cbebd2941', 'request_id': 'req-c1ff52f4-756e-4db3-b493-0bb4b168ad26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:42.226600 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] The token cache is being invalidate because project 370ce126852b40f88449170cbebd2941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:42.226915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:42.227636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1ff52f4-756e-4db3-b493-0bb4b168ad26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:42.231422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1014/2041] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:42 2022] DELETE /identity/v3/projects/370ce126852b40f88449170cbebd2941 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:42.234949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e018-852e-4e07-a6a3-ed1240b941e1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.235242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e018-852e-4e07-a6a3-ed1240b941e1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.235559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e018-852e-4e07-a6a3-ed1240b941e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.242962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1475-3eff-464a-b867-68636b329f0f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.270977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c0e0e018-852e-4e07-a6a3-ed1240b941e1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:42.272877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c0e0e018-852e-4e07-a6a3-ed1240b941e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.346032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.346845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.347216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.347602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.348491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.351594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.384060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1028/2042] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:42.388991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.392910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.399683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1015/2043] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:42.407091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.407406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.407697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.434849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f5bf-976c-4347-a070-603e952b2c98 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.439500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:42.440814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.447137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.449612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.450218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.450923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.452648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.457823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.458307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1016/2044] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:42.460173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.487586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9085d6-d18b-4d83-b06e-e69d407ceb2d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.487812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1029/2045] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:42.489451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.496132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.497137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.497542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.498007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.498946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:42.499344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.501599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.528035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0714-3dfb-4b1d-a43c-0e0fe2484b25 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.541875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1017/2046] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:42.544434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.547188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.548511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.549442 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.551353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.553764 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.556380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.574061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8b5e-cb58-4bfc-adc1-9a31475f3f1f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.583331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1030/2047] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:42.587322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.590065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.591569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.592720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.597219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.600582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.606631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.619284 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7c8ce-186b-4cca-bf8d-350991b1f63a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.624921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.626940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.627241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.627561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] PATH_INFO: `/v3/projects/8ffd0584f98b44cc8e1c6e9cc300bc57/users/cf16065108434b7a9fd2198a0673a3d1/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.650082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffd0584f98b44cc8e1c6e9cc300bc57, user_id=cf16065108434b7a9fd2198a0673a3d1, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.651913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1018/2048] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:42.656262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.656431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2cd5e-ebcc-4efc-a7e3-71d0bdde5d00 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.672799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1031/2049] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:42 2022] PUT /identity/v3/projects/8ffd0584f98b44cc8e1c6e9cc300bc57/users/cf16065108434b7a9fd2198a0673a3d1/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:42.683818 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.684112 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.684401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.714519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] MFA Rules not processed for user `cf16065108434b7a9fd2198a0673a3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:42.715855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:42.746672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66576d01-e2fc-4d5b-a93f-4417504941cf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.811944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1032/2050] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:42.816477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.868142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.869605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.869965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.870246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.871181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.873565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.906361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1019/2051] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:42.907542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.913746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c5f6c-59b9-4e52-8b98-bbf8a6616e24 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.923835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08679b-ffee-4fa7-b6c8-51798e572547 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.930899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.932098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.932403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.932588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.933663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.936172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.936381 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.937147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.937529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.938175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.939062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.942838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.954327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1020/2052] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:42.957994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:42.971268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaa8d1-642e-4aa9-838c-02b1ea327255 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:42.978833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:42.979958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:42.980324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:42.980744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:42.981830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:42.984413 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:42.986210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1033/2053] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:42.992963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.008327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1021/2054] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:43.008327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.020740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492f6b5-19f9-4ced-8719-530a6e3348c9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.121395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.122867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.123809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.124244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] PATH_INFO: `/v3/projects/3d7358eadfcf4945827a4edb90a65f95/users/1ca6e35f1e09477286057adb283d1515/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.127156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6026c-a3e5-4ad4-a67f-bd742eb27f73 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.134930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.135738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.135939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.136389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.136924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.138879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1a1eb-9147-447c-9066-92dfd018c88d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.150677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7358eadfcf4945827a4edb90a65f95, user_id=1ca6e35f1e09477286057adb283d1515, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.153835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.179271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1022/2055] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:43 2022] PUT /identity/v3/projects/3d7358eadfcf4945827a4edb90a65f95/users/1ca6e35f1e09477286057adb283d1515/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:43.179571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1034/2056] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:42 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:43.179738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.181094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.181405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.181699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.216443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] MFA Rules not processed for user `1ca6e35f1e09477286057adb283d1515`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:43.217966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:43.258805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f404b16-d3f7-40e0-ab26-aa8baba4f8a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.266612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.268295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.268738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.269826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.271085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.275335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.287195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1023/2057] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:43.292246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.301590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1035/2058] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:43.302480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262c88f-7ba4-4518-a37c-1f27a4a2e4d7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.307025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.310828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.311907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.312259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.312707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] PATH_INFO: `/v3/projects/f48faa32c9f144498709cf08aac97d8d/users/d417f28a5b2c471887d5271297054ff5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.322279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b5305-fcc5-418b-83d6-cb19ec3f406f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.330372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48faa32c9f144498709cf08aac97d8d, user_id=d417f28a5b2c471887d5271297054ff5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.331356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.332131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.332419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.332701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.333506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.333610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.336460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.351143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1024/2059] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:43 2022] PUT /identity/v3/projects/f48faa32c9f144498709cf08aac97d8d/users/d417f28a5b2c471887d5271297054ff5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:43.355117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.370659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1036/2060] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:43.375968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.472270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc76456-6805-48bf-9748-53af973ace1c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.481402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa895945-dcfe-4dd9-9009-244e595df9ad admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.487991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.488922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.489224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.489575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.490241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.490372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.492250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.492540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.492824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.493349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.493584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.495232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.524274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1037/2061] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:43 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:43.526188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1025/2062] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:43.529256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.529546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.545427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7cb6-06b2-4022-872b-524e941a8c51 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.559098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.561647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.562575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.562947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.564553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.566855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8407-83d2-4618-89af-59aa16184a47 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.567776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.579588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.581228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.581899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.582352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] PATH_INFO: `/v3/projects/f48faa32c9f144498709cf08aac97d8d/users/d417f28a5b2c471887d5271297054ff5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.586513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48faa32c9f144498709cf08aac97d8d, user_id=d417f28a5b2c471887d5271297054ff5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.591052 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e27f2-00df-49df-8925-81a0c074d351 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.596777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1026/2063] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:43.602027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.610709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1038/2064] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:43 2022] PUT /identity/v3/projects/f48faa32c9f144498709cf08aac97d8d/users/d417f28a5b2c471887d5271297054ff5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:43.622693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.623263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.623776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.625922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfc04e-b4fa-4ec5-9c3a-f2dfd27d00d7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.674078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] MFA Rules not processed for user `d417f28a5b2c471887d5271297054ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:43.676101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:43.740374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.741639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.742259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.742496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] PATH_INFO: `/v3/projects/54a49a0d2489467482b442e493826561/users/45e68f6ebbbd4c77b8e1b6478d14b4db/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.779128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a49a0d2489467482b442e493826561, user_id=45e68f6ebbbd4c77b8e1b6478d14b4db, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.782270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.789350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1039/2065] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:43.798067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.800241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:43.819617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1027/2066] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:43 2022] PUT /identity/v3/projects/54a49a0d2489467482b442e493826561/users/45e68f6ebbbd4c77b8e1b6478d14b4db/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:43.824149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:43.904402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e7137-04da-47e2-a9bd-15c4b425106d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.958616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf08fc-dd9c-4f72-a486-91d2ff3826c0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:43.965065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:43.966396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:43.966538 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:43.966869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:43.968175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:43.969985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:43.986056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1028/2067] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:45:43.990356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:44.000949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:44.001895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:44.002302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:44.002654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:44.005137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:44.013119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e6a0-f8a7-4258-b92a-695ad828c758 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:44.020140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:44.021184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:44.021536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:44.022214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] PATH_INFO: `/v3/projects/54a49a0d2489467482b442e493826561/users/45e68f6ebbbd4c77b8e1b6478d14b4db/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:44.035528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a49a0d2489467482b442e493826561, user_id=45e68f6ebbbd4c77b8e1b6478d14b4db, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:44.039638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d610111-a0b6-49ba-b624-16dc255665cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:44.075484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1029/2068] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:43 2022] PUT /identity/v3/projects/54a49a0d2489467482b442e493826561/users/45e68f6ebbbd4c77b8e1b6478d14b4db/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:44.087421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:44.087808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:44.088296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:44.154770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] MFA Rules not processed for user `45e68f6ebbbd4c77b8e1b6478d14b4db`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:44.159473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:44.194606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:44.196921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:44.213534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1040/2069] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:44.313578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1030/2070] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:44.332336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:44.334082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:44.352741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813f02c-cc20-490d-8d6e-ca1c94eb7e89 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:44.433805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:44.434595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:44.435017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:44.435386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:44.449096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:44.450702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:44.467163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1041/2071] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:44.603291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:44.617517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c927b-378d-4139-9711-c75d8f854d0b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:44.624474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:44.625578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:44.626401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:44.627038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:44.738859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:44.741466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:44.750960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1031/2072] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:47.049846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:47.059307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9a4dc-80d3-422b-b1c8-39a6f046076a service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:47.064459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:47.065164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:47.065449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:47.065732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:47.129860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:47.131719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:47.142690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1042/2073] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:47.817876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:47.828822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd44571-1e3d-4afa-9adb-9c9fe0603f7d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:47.835086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:47.836157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:47.836577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:47.836985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:47.911253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:47.912891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac5958-296d-49a8-b04a-a6cff3609e62 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:47.923053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1032/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:48.498859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:48.579789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1a06b-00a2-4215-89c2-617d35e12486 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:48.585290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:48.586165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:48.586452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:48.586728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] PATH_INFO: `/v3/users/1ca6e35f1e09477286057adb283d1515` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:48.588026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca6e35f1e09477286057adb283d1515)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:48.589965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:48.636104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca6e35f1e09477286057adb283d1515'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:48.636776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca6e35f1e09477286057adb283d1515'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:48.650269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca6e35f1e09477286057adb283d1515'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:48.651243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca6e35f1e09477286057adb283d1515'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:48.659827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca6e35f1e09477286057adb283d1515'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:48.673481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1043/2075] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:48 2022] DELETE /identity/v3/users/1ca6e35f1e09477286057adb283d1515 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:48.678655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:48.678895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:48.679567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:48.697064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:48.698296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:48.760689 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1033/2076] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:48.775741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:48.777206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:48.841252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c48f8e-c31b-420f-8ce4-a18fde45ab2c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:48.845008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:48.845672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:48.845959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:48.846235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:48.864239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:48.866516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:48.877119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1044/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:49.733756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:49.735819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:49.757911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74011ca-8cea-455b-9cf2-0c40a8919477 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:49.766246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:49.767275 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:49.767615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:49.767968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] PATH_INFO: `/v3/projects/3d7358eadfcf4945827a4edb90a65f95` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:49.769177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7358eadfcf4945827a4edb90a65f95)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:49.771822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:49.826324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7358eadfcf4945827a4edb90a65f95', 'request_id': 'req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.832610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7358eadfcf4945827a4edb90a65f95', 'request_id': 'req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.840988 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7358eadfcf4945827a4edb90a65f95', 'request_id': 'req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.853312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] The token cache is being invalidate because project 3d7358eadfcf4945827a4edb90a65f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:49.853595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.854252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.855863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1034/2078] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:49 2022] DELETE /identity/v3/projects/3d7358eadfcf4945827a4edb90a65f95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:49.860111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:49.871509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a65f9-1088-435c-9849-746fccf5937c service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:49.930161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:49.931078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:49.931387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:49.931672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] PATH_INFO: `/v3/users/45e68f6ebbbd4c77b8e1b6478d14b4db` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:49.932946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e68f6ebbbd4c77b8e1b6478d14b4db)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:49.934956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:49.986842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e68f6ebbbd4c77b8e1b6478d14b4db'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:49.987898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e68f6ebbbd4c77b8e1b6478d14b4db'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.002057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e68f6ebbbd4c77b8e1b6478d14b4db'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.003110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e68f6ebbbd4c77b8e1b6478d14b4db'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.012749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00fb6174-1b60-47e5-9acb-670c9d69a5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e68f6ebbbd4c77b8e1b6478d14b4db'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.042492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1045/2079] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:49 2022] DELETE /identity/v3/users/45e68f6ebbbd4c77b8e1b6478d14b4db => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:50.450502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:50.458902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:50.526925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6d0cf-4c4b-4edd-b6d2-9575204d157c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:50.662396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:50.663358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:50.664240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:50.664240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] PATH_INFO: `/v3/projects/54a49a0d2489467482b442e493826561` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:50.665243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a49a0d2489467482b442e493826561)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:50.667377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:50.773343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a49a0d2489467482b442e493826561', 'request_id': 'req-356a41da-8c4e-44b0-82f6-ebf2424a6515'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.789662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a49a0d2489467482b442e493826561', 'request_id': 'req-356a41da-8c4e-44b0-82f6-ebf2424a6515'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.812324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a49a0d2489467482b442e493826561', 'request_id': 'req-356a41da-8c4e-44b0-82f6-ebf2424a6515'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.863773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] The token cache is being invalidate because project 54a49a0d2489467482b442e493826561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:50.863773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.867470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-356a41da-8c4e-44b0-82f6-ebf2424a6515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:50.871382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1035/2080] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:50 2022] DELETE /identity/v3/projects/54a49a0d2489467482b442e493826561 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:50.876041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:50.876575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:50.876654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:50.898209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:50.902198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:51.022920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1046/2081] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:51.033863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.034455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.034930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.065925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:51.068111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:51.081941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1036/2082] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:51.086519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.098594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5bcd-45b8-4352-878f-8b3b7ec0085b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.105267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.106473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.113745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.114409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.115414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:51.117039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.118876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.141273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1047/2083] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:51.142673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.153979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd7482-bfcd-475a-bc9f-7295906c7ffe None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.167309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.168628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.169255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.171445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.172603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.175573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.226450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.234598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1037/2084] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:51.239189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18cc74-1c4d-41ff-bb51-68f02877af01 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.338015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.338857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.339179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.339663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.340671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.342757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.367338 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1048/2085] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:51.377540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.390150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8bb51-087e-4a33-8afe-27107301cc8c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.396213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.397527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.397824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.398101 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.399107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.400790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.412531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1038/2086] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:51.416372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.426824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67e53f-e058-45b5-9ad3-d68298c563cc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.436149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.436946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.437310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.437699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.438556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.440271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4e715-f405-4ac5-94e4-84296d81f78a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.458850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1049/2087] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:51.463834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.477910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f910585-e288-43b9-87d6-01e46f90b36b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.482901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.483842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.484129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.484409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] PATH_INFO: `/v3/projects/265cc4d4d611424d99c0c0fdcd591943/users/e09eafe3c75b4d3ab9d285c6c92c4b9e/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.504612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] RBAC: Authorizing `identity:create_grant(project_id=265cc4d4d611424d99c0c0fdcd591943, user_id=e09eafe3c75b4d3ab9d285c6c92c4b9e, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.508843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.529213 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1039/2088] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:51 2022] PUT /identity/v3/projects/265cc4d4d611424d99c0c0fdcd591943/users/e09eafe3c75b4d3ab9d285c6c92c4b9e/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:51.540995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.541363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.541743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.579504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] MFA Rules not processed for user `e09eafe3c75b4d3ab9d285c6c92c4b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:51.581584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:51.691505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1050/2089] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:51.703901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.809799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e1dfb-4fce-4fbd-bca6-6f5b13c803be admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:51.817984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:51.819807 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:51.820319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:51.821151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:51.822057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:51.824449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:51.876809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1040/2090] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:51.880755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:51.892800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15250483-eb40-4e01-a37c-689c226ae07f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.013630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.017107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.017922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.019270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.020959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.027204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.079208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1051/2091] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:51 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:52.083225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.096151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf285-7f58-4a56-982a-e2dcc14b3b18 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.104468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.105339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.105765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.106145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.107081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.109021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43886f7e-b262-40ef-ae58-c4f612d3f7bd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.135139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1041/2092] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:52.139506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.158311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987777-28e2-4480-b69b-c8092d278264 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.167046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.168282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.168750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.169924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] PATH_INFO: `/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082/users/b48f4352fca6413c8207599caa5e9ade/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.196362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f7f3ac34124f3fb7480edd2a9c9082, user_id=b48f4352fca6413c8207599caa5e9ade, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.199667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.234891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1052/2093] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:52 2022] PUT /identity/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082/users/b48f4352fca6413c8207599caa5e9ade/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:52.236095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.239235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.240005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.242768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.290769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:52.292675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.354535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b125-612c-4147-8283-9129d3fe7ab4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.359588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.360278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.360563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.360835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.361996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.363718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.378292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1053/2094] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:52.386742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.408731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c372a-e4e1-45b3-8749-9050cd9708db admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.426735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.427685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.428560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.428845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] PATH_INFO: `/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082/users/b48f4352fca6413c8207599caa5e9ade/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.432143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f7f3ac34124f3fb7480edd2a9c9082, user_id=b48f4352fca6413c8207599caa5e9ade, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.436499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9716a-adad-4f1f-8bd4-a955d9f00899 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.451656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1042/2095] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:45:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:52.451656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.456303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.469767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1054/2096] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:52 2022] PUT /identity/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082/users/b48f4352fca6413c8207599caa5e9ade/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:52.480875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.481064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.481351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.515770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a983-046e-413c-878b-6a4c01388c43 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.547610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] MFA Rules not processed for user `b48f4352fca6413c8207599caa5e9ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:52.549239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.655206 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.656119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.656414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.656697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] PATH_INFO: `/v3/users/9f97ffb4ad344d47b47474e9037b7ff3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.658897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f97ffb4ad344d47b47474e9037b7ff3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:52.661823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:52.697357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1055/2097] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:52.698543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.700139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.749029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f97ffb4ad344d47b47474e9037b7ff3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:52.759526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f97ffb4ad344d47b47474e9037b7ff3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:52.778227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f97ffb4ad344d47b47474e9037b7ff3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:52.779223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f97ffb4ad344d47b47474e9037b7ff3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:52.781500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f97ffb4ad344d47b47474e9037b7ff3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:52.813466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1043/2098] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:52 2022] DELETE /identity/v3/users/9f97ffb4ad344d47b47474e9037b7ff3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:52.815127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:52.816805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.836989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a3a2-84f7-4813-b5e0-bc77570079a2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.916631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a055e6e-3f46-498d-8d9e-6bc0175734f1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:52.922728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.926860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.927336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.930798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.933639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:52.935775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:52.936883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:52.937283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:52.937775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:52.940667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:53.047160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:53.047580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:53.048899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:53.049847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18858b-b1f1-4fd6-928d-187460429db6 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:53.079716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1044/2099] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:53.081050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1056/2100] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:45:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:45:53.082695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:53.082993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:53.083279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:53.105392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:53.106648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:53.217220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1057/2101] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:53.234974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:53.238730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:53.326890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277373-6ddd-4468-b848-d8a672773c93 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:53.331013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:53.331727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:53.332003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:53.332283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:53.344630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:53.346028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:53.364952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1045/2102] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:54.069632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:54.074924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:54.136472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60bd7-b217-41cc-951a-7df8cdf59d4b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:54.154660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:54.156105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:54.156699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:54.157199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] PATH_INFO: `/v3/projects/a9709ba15cbd43a1afdaf1d4985a9b63` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:54.159623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9709ba15cbd43a1afdaf1d4985a9b63)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:54.162315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:54.268105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9709ba15cbd43a1afdaf1d4985a9b63', 'request_id': 'req-6b49e696-6af7-4cc3-92ea-e14434bf4b81'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.300663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9709ba15cbd43a1afdaf1d4985a9b63', 'request_id': 'req-6b49e696-6af7-4cc3-92ea-e14434bf4b81'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.317376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9709ba15cbd43a1afdaf1d4985a9b63', 'request_id': 'req-6b49e696-6af7-4cc3-92ea-e14434bf4b81'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.350724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] The token cache is being invalidate because project a9709ba15cbd43a1afdaf1d4985a9b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:54.351249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.353072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b49e696-6af7-4cc3-92ea-e14434bf4b81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.356278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1058/2103] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:54 2022] DELETE /identity/v3/projects/a9709ba15cbd43a1afdaf1d4985a9b63 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:54.360220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:54.373369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ae97b-1566-4794-9d5d-d009ff8a0f41 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:54.418200 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:54.418587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:54.419019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:54.452146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:54.453854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:54.503001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:54.504182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:54.504706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:54.505136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] PATH_INFO: `/v3/users/cf16065108434b7a9fd2198a0673a3d1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:54.507647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf16065108434b7a9fd2198a0673a3d1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:54.510104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:54.610398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf16065108434b7a9fd2198a0673a3d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.619884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1059/2104] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:45:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:45:54.622635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf16065108434b7a9fd2198a0673a3d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.639583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:54.642650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:54.662154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf16065108434b7a9fd2198a0673a3d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.664403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf16065108434b7a9fd2198a0673a3d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.666362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bc0955-7d34-4936-96df-f4094a50902c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf16065108434b7a9fd2198a0673a3d1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:54.699855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1046/2105] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:54 2022] DELETE /identity/v3/users/cf16065108434b7a9fd2198a0673a3d1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:54.815334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614bab-cac2-4c3b-a175-dd5706ef7def None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:54.916468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:54.917157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:54.917448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:54.917732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:54.922134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:55.029638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:55.031742 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:55.044576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1060/2106] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:45:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:45:55.560536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:55.561975 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:55.562617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:55.571697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:55.573476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:55.680854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43ec37-d382-47be-b9d4-d5ceeb697bf8 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:55.688516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:55.689585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:55.689937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:55.690285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] PATH_INFO: `/v3/projects/8ffd0584f98b44cc8e1c6e9cc300bc57` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:55.694712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffd0584f98b44cc8e1c6e9cc300bc57)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:55.700466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:55.706409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:55.715458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:55.730443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1047/2107] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:45:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:55.756610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:55.764315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:55.785608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56559821-6ce4-43a7-866b-4fdd900aaa1b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:55.792241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:55.793440 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:55.794150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:55.794639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:55.806341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:55.808661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:55.837138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1048/2108] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:45:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:45:55.841770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffd0584f98b44cc8e1c6e9cc300bc57', 'request_id': 'req-f746b287-24ea-40e5-830c-3155cf02a847'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:55.852886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffd0584f98b44cc8e1c6e9cc300bc57', 'request_id': 'req-f746b287-24ea-40e5-830c-3155cf02a847'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:55.863405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffd0584f98b44cc8e1c6e9cc300bc57', 'request_id': 'req-f746b287-24ea-40e5-830c-3155cf02a847'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:55.879405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] The token cache is being invalidate because project 8ffd0584f98b44cc8e1c6e9cc300bc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:55.879707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:55.889579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f746b287-24ea-40e5-830c-3155cf02a847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:55.894987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1061/2109] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:55 2022] DELETE /identity/v3/projects/8ffd0584f98b44cc8e1c6e9cc300bc57 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:55.897685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:55.910428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e236c-051d-40e6-aeb5-8fe4ee275e55 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:56.021642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:56.023024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:56.023470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:56.023930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] PATH_INFO: `/v3/users/d417f28a5b2c471887d5271297054ff5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:56.026317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d417f28a5b2c471887d5271297054ff5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:56.029625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:56.111099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd417f28a5b2c471887d5271297054ff5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.129588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd417f28a5b2c471887d5271297054ff5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.164223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd417f28a5b2c471887d5271297054ff5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.165276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd417f28a5b2c471887d5271297054ff5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.166222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd417f28a5b2c471887d5271297054ff5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.224776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1049/2110] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:55 2022] DELETE /identity/v3/users/d417f28a5b2c471887d5271297054ff5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:45:56.609893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:56.610668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:56.611500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:56.665995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:56.667775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:56.698591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:56.710684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:56.772896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1062/2111] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:45:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:56.774346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:56.776312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:56.847819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c200-491a-4c45-bec2-5635c6563c74 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:56.853877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:56.855164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:56.855697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:56.856104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] PATH_INFO: `/v3/users/00abd55c438d40e2a2e709f4ad215cbc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:56.858620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00abd55c438d40e2a2e709f4ad215cbc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:56.861664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:56.884269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f23478-27d8-4ad3-b996-7dbf5d581ba4 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:56.892584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:56.893930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:56.894403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:56.894877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] PATH_INFO: `/v3/users/ca6c3d8d36db4f5fbc6c24834f81f599` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:56.897686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6c3d8d36db4f5fbc6c24834f81f599)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:56.900767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:56.930607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00abd55c438d40e2a2e709f4ad215cbc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.944936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00abd55c438d40e2a2e709f4ad215cbc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.960227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00abd55c438d40e2a2e709f4ad215cbc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.960945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00abd55c438d40e2a2e709f4ad215cbc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.961655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00abd55c438d40e2a2e709f4ad215cbc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.967397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6c3d8d36db4f5fbc6c24834f81f599'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.967828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6c3d8d36db4f5fbc6c24834f81f599'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:56.977631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1050/2112] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:56 2022] DELETE /identity/v3/users/00abd55c438d40e2a2e709f4ad215cbc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:56.983887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:56.985558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.005609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6c3d8d36db4f5fbc6c24834f81f599'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.007326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6c3d8d36db4f5fbc6c24834f81f599'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.017738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6c3d8d36db4f5fbc6c24834f81f599'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.032588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1063/2113] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:56 2022] DELETE /identity/v3/users/ca6c3d8d36db4f5fbc6c24834f81f599 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:57.035927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.036068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.083419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76691bc5-3fe6-4ec8-99c6-8b9cf521066a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.135670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff668f-5a5c-4c6d-84c4-5cbcaa736b2d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.144459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.145362 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.145654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.145938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] PATH_INFO: `/v3/projects/f48faa32c9f144498709cf08aac97d8d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.147799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48faa32c9f144498709cf08aac97d8d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.149942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.187730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.188920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.189678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.190300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.194743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.232733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48faa32c9f144498709cf08aac97d8d', 'request_id': 'req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.257067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48faa32c9f144498709cf08aac97d8d', 'request_id': 'req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.278158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48faa32c9f144498709cf08aac97d8d', 'request_id': 'req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.300961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] The token cache is being invalidate because project f48faa32c9f144498709cf08aac97d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:57.301274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.302670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.305554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1064/2114] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:57 2022] DELETE /identity/v3/projects/f48faa32c9f144498709cf08aac97d8d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:57.306933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.308728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd4d7a-9097-4336-8f39-0297d5d1a716 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.309665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.314650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.320576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1051/2115] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:45:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:45:57.328619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.328917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.329204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.360506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:57.361804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.429307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6b624-9c2f-4a5b-8741-ced41bcb5de8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.435501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.436419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.436760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.437053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] PATH_INFO: `/v3/projects/37392e80feea490886351ac375315eef` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.438527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37392e80feea490886351ac375315eef)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.440836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.447427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1052/2116] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:57.448498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.450801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.471353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d14db-d46d-4dd9-bb3d-60bf0cc50975 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.480340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.481753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.482203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.488110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] PATH_INFO: `/v3/projects/98c641670665465caa49f5d709911793` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.489602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c641670665465caa49f5d709911793)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.491808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.512973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37392e80feea490886351ac375315eef', 'request_id': 'req-00943924-7d61-40ac-b031-29b1c43354b6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.549074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37392e80feea490886351ac375315eef', 'request_id': 'req-00943924-7d61-40ac-b031-29b1c43354b6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.562245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37392e80feea490886351ac375315eef', 'request_id': 'req-00943924-7d61-40ac-b031-29b1c43354b6'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.585715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c641670665465caa49f5d709911793', 'request_id': 'req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.597465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] The token cache is being invalidate because project 37392e80feea490886351ac375315eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:57.598402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.599660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-00943924-7d61-40ac-b031-29b1c43354b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.601839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c641670665465caa49f5d709911793', 'request_id': 'req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.606351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1065/2117] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:57 2022] DELETE /identity/v3/projects/37392e80feea490886351ac375315eef => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:57.606351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd6f3-9f98-4578-abcd-4c02851dd570 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.606351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd6f3-9f98-4578-abcd-4c02851dd570 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.607448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fd6f3-9f98-4578-abcd-4c02851dd570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.636784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c641670665465caa49f5d709911793', 'request_id': 'req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.644611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-854fd6f3-9f98-4578-abcd-4c02851dd570 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:57.647599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-854fd6f3-9f98-4578-abcd-4c02851dd570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.657340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] The token cache is being invalidate because project 98c641670665465caa49f5d709911793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:57.657658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.658916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.660898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1053/2118] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:57 2022] DELETE /identity/v3/projects/98c641670665465caa49f5d709911793 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:57.661725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.663766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.786182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9960d-b9c2-48d9-8040-ffb62f2eebc9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.791685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1066/2119] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:57.791685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.791685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.792301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.802224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.804533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.805108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.805645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] PATH_INFO: `/v3/users/e44ad1af22f842a9ac320cf9edcc836e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.808171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44ad1af22f842a9ac320cf9edcc836e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.811874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.827761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:57.829844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.844623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1067/2120] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:57.846342 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.870078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd50d1e-215b-4463-9779-c0afc0e5cfcb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.881666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.883285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.883796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.884804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.886602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:57.887177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:57.890570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1581-7b9b-496c-9f5c-70a23b0d5cdb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:57.913793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1068/2121] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:57.919410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.919717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.920000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.933046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44ad1af22f842a9ac320cf9edcc836e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.948520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44ad1af22f842a9ac320cf9edcc836e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.956564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:57.958789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:57.973127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1069/2122] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:57.973127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:57.975646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44ad1af22f842a9ac320cf9edcc836e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.977244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44ad1af22f842a9ac320cf9edcc836e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.979617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44ad1af22f842a9ac320cf9edcc836e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:57.986669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943ebb-193d-47ee-92ae-448e772f169a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:57.994640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:57.995453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:57.995792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:57.996093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:57.997018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.001075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.042148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1070/2123] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:57 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:58.042148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.043195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1054/2124] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:45:57 2022] DELETE /identity/v3/users/e44ad1af22f842a9ac320cf9edcc836e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:58.043195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.046982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.047937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.185426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecb4ba-7651-48e4-a356-4de8c4b7faab admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.195397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.197271 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.198187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.198187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.199773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:58.200316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.204581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.235546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1071/2125] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:58.240072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ac6b3-a1c9-46a6-90dc-2ba6437a81df admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.242079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.248950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.248950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.248950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.249547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.250001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.252645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.295783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f276-7744-431f-b5b0-ea9e30b17bb7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.298403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1055/2126] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:58.303605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.309127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.309833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.310162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.310503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.311800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.314723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.321252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d672a8e-ff63-471f-b0dd-f42edbd0ab17 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.330873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.331747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.331924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.332294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.333648 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.338293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.357568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1056/2127] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:58.362817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.371589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1072/2128] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:58.373232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.389993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c9cb-f236-436f-a974-06d99c10830a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.486988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46f6b-39c3-411a-9a14-04029fb2b497 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.498348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.499241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.499648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.500058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.500953 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.503096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.514711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.514711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.514711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.514711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.515286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.517726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.534570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1073/2129] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:58.539810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.542549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.544021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1057/2130] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:58.545479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.560738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc29fb-553e-4996-9e99-98a0c705e801 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.565922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.566345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626812-47f8-48a2-ae0c-90593fc5c983 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.567146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.567704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.568104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] PATH_INFO: `/v3/projects/ad54179601194a778b042b50c9b63ece` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.570307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad54179601194a778b042b50c9b63ece)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.573068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.578436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.579542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.580068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.580485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.581736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.586735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.610069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1058/2131] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:58.610069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.619286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1812e0-8c32-44f8-9d38-118241cd9076 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.626118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.627198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.627507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.627841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] PATH_INFO: `/v3/projects/563af4481d544b74bc5afba3f426e7e5/users/f5a10f7c3b0a41ca8bd08cb83f850c38/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.649856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563af4481d544b74bc5afba3f426e7e5, user_id=f5a10f7c3b0a41ca8bd08cb83f850c38, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.653091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.661921 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad54179601194a778b042b50c9b63ece', 'request_id': 'req-8ce646c6-f367-46e9-a03d-88f6aa497e21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:58.671645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1059/2132] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:58 2022] PUT /identity/v3/projects/563af4481d544b74bc5afba3f426e7e5/users/f5a10f7c3b0a41ca8bd08cb83f850c38/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:58.673130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.680993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad54179601194a778b042b50c9b63ece', 'request_id': 'req-8ce646c6-f367-46e9-a03d-88f6aa497e21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:58.694333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad54179601194a778b042b50c9b63ece', 'request_id': 'req-8ce646c6-f367-46e9-a03d-88f6aa497e21'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:58.711019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] The token cache is being invalidate because project ad54179601194a778b042b50c9b63ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:45:58.711312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:58.712975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8ce646c6-f367-46e9-a03d-88f6aa497e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:45:58.720897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1074/2133] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:45:58 2022] DELETE /identity/v3/projects/ad54179601194a778b042b50c9b63ece => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:58.721628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36e60-e70c-4596-ab7a-21c3ce269c34 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.721929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36e60-e70c-4596-ab7a-21c3ce269c34 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.722267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d36e60-e70c-4596-ab7a-21c3ce269c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.750155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9d66d-aab2-4cca-8179-24ee51a1da48 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.752227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-78d36e60-e70c-4596-ab7a-21c3ce269c34 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:58.754318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-78d36e60-e70c-4596-ab7a-21c3ce269c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.759285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.760014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.760292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.760566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.761312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.767508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.775655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1075/2134] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:58.777312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.777750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.778078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.795950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1060/2135] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:58.800289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.803611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.825658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:58.827949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.847495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1076/2136] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:58.848615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:58.851040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.869228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c029-ead1-416a-bccd-0a046f95ae47 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.877586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.878721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.879195 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.879682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] PATH_INFO: `/v3/projects/53d3d0c1787d483187f54f75b37d469a/users/37501fd80d5348a9a5f34bfc4b118e05/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.905081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d3d0c1787d483187f54f75b37d469a, user_id=37501fd80d5348a9a5f34bfc4b118e05, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.906559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b6485-f9d9-4a39-ac98-bf40364db9c3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:58.908298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d2402-bfc4-407e-b4ad-8b81375332f3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.913532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:58.914981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.915461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.916424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.926086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1077/2137] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:58 2022] PUT /identity/v3/projects/53d3d0c1787d483187f54f75b37d469a/users/37501fd80d5348a9a5f34bfc4b118e05/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:58.927542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.927873 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.928304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:58.947056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:58.949219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ca161-c742-4c1b-a9df-ae8b0fe0dbc1 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:58.961467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:58.962766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:58.962968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1061/2138] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:58.964724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:58.965343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:58.965844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.005122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] MFA Rules not processed for user `37501fd80d5348a9a5f34bfc4b118e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:59.008015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:59.085743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1078/2139] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:59.092325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.110079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4d8d-1880-407d-8dbc-03aca696c8de None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.118563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.119857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.119857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.120911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.120911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:45:59.121924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.122752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.140696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1079/2140] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:45:59.140899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1062/2141] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:45:59.142850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.143423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.155241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5d30b-f3c8-48a9-a23a-c3f4cb9e849c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.160911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.161268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5229c-a37a-4194-9dba-298b4e783d64 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.161605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.161892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.162295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.163015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.165170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.169070 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.169854 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.170212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.170574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.171474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.174128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.207697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1080/2142] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:59 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:59.214950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.227351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1063/2143] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:45:59 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:59.231035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.325248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88fb2c-4b23-4104-a50b-f17c986e8200 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.340391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c72b9-8571-4c1b-b26c-4b62761d420e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.347116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.348224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.348782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.348782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.349748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.353043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.386922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1064/2144] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:59 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:45:59.392553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.407013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a746f8-95c0-4c7f-9509-f4288a3b872c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.420629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.421919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.422423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.422829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.424194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.427716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.440531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.441508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.442007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.442498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.444847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.445571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1065/2145] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:59.450481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.453668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.469979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a25ff-3c03-410d-ab0a-fd59afe3d7ae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.479256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.480497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.480791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.481729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] PATH_INFO: `/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2/users/65394faaae134873868cf06868ffb5b0/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.495237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1081/2146] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:45:59 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:45:59.500378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.502667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:59.513656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff5a21a83294aafbccf59af6eec6bf2, user_id=65394faaae134873868cf06868ffb5b0, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.519215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.545186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1066/2147] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:59 2022] PUT /identity/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2/users/65394faaae134873868cf06868ffb5b0/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:59.546513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.627836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4478e9-8c12-4f0f-9cfc-d3742890ca8e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.664303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e50d3f-e350-4cfc-ab36-00fa54da0be8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.672529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.674443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.674990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.675524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.676730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.679331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.694800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1067/2148] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:59.696327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.703522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.704585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.705487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.705487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.708582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:45:59.716881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa5dc3-7f56-4242-bf94-f444d77e4720 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.726157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.727343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.727900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.728376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.729812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.733068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.752921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1068/2149] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:59.754493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.769673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e95563-382c-45ac-98db-166f1df718f1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.778343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.778343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.778343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.778343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.780962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.780962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.794088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1069/2150] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:45:59.794744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.808680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa705a1-32f2-4cf7-a384-d4e10ede9655 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.814399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:45:59.815149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.815475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.816411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] PATH_INFO: `/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2/users/65394faaae134873868cf06868ffb5b0/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.818973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.819114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff5a21a83294aafbccf59af6eec6bf2, user_id=65394faaae134873868cf06868ffb5b0, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:45:59.820666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.822364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324789c-9dee-4113-900d-64f8484413bd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:45:59.833474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1082/2151] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:45:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:45:59.833861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1070/2152] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:59 2022] PUT /identity/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2/users/65394faaae134873868cf06868ffb5b0/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:45:59.836475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:45:59.853738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:45:59.853738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:45:59.853893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:45:59.867534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc31a0-ce16-4ebb-b3fb-ce6c45ea9674 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:45:59.894747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] MFA Rules not processed for user `65394faaae134873868cf06868ffb5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:45:59.897969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.001749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.002815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.003109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.003415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] PATH_INFO: `/v3/projects/d4d2549d6aec4acebc397538107d5ffd/users/75ef29d31d3e48ee9bc61b9a1fe111ec/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.028674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d2549d6aec4acebc397538107d5ffd, user_id=75ef29d31d3e48ee9bc61b9a1fe111ec, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.029882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1071/2153] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:45:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:00.031034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:00.032369 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.033228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.054959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bd965-bf07-4bf0-951a-81fd2c9b5f62 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:00.072663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1083/2154] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:45:59 2022] PUT /identity/v3/projects/d4d2549d6aec4acebc397538107d5ffd/users/75ef29d31d3e48ee9bc61b9a1fe111ec/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:00.073603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:00.077412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.143085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.144049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.144333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.144638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] PATH_INFO: `/v3/users/552433b497424e6fab5e83a5b3887d61` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.146673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=552433b497424e6fab5e83a5b3887d61)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.148779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.178602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc822df4-0b1a-4098-8687-d5c99d8ef565 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:00.187678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.189579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.190701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.191527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.237007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552433b497424e6fab5e83a5b3887d61'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:00.249120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552433b497424e6fab5e83a5b3887d61'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:00.292313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552433b497424e6fab5e83a5b3887d61'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:00.293620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552433b497424e6fab5e83a5b3887d61'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:00.294578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-81619a98-df11-4dac-adf9-0fee75d44249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552433b497424e6fab5e83a5b3887d61'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:00.318151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1072/2155] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:00 2022] DELETE /identity/v3/users/552433b497424e6fab5e83a5b3887d61 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:00.331143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ea43-be1d-4b59-a5c9-9ead19841eb7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.335027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ea43-be1d-4b59-a5c9-9ead19841eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.335507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9ea43-be1d-4b59-a5c9-9ead19841eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.375480 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.385726 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab0bc-a7e9-4f82-bff9-77e05d1185d5 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.401395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-30a9ea43-be1d-4b59-a5c9-9ead19841eb7 None None] MFA Rules not processed for user `f5a10f7c3b0a41ca8bd08cb83f850c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:00.405259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30a9ea43-be1d-4b59-a5c9-9ead19841eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.428828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1084/2156] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:00.431496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.431922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.432331 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.500105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1073/2157] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:00.501671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.502016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.502271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.509994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] MFA Rules not processed for user `75ef29d31d3e48ee9bc61b9a1fe111ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:00.511285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.525625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:00.527644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.631601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1074/2158] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:00.631601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:00.641218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.644894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1085/2159] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:00.646132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:00.651833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.723332 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d8c73-12d9-4335-8425-718f7168ad0f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:00.727022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0ed3-45f6-42e6-8211-a465f0e065b6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:00.728781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.729522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.729896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.730102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.731584 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.732320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.732718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.733066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.742910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.745524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.745682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.748235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.761251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1086/2160] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:00.762568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:00.763642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1075/2161] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:00.765197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:00.786387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1e646-a1c0-4d99-b69c-3472162526b0 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:00.793388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:00.794249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:00.794682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:00.795160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:00.808653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:00.810451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469440f-76ef-4611-841b-b5bf7f5456cb service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:00.824870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1087/2162] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:01.078849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.080454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.128016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2ff21-0193-4e1e-af9f-9140e9bd412d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.143835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.145262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.145772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.146204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] PATH_INFO: `/v3/projects/29260c09fcef4a49a7f9b244feca77cb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.148695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29260c09fcef4a49a7f9b244feca77cb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.152567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.273610 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29260c09fcef4a49a7f9b244feca77cb', 'request_id': 'req-7b81ae34-691d-413c-a8d0-06863199355d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.281272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29260c09fcef4a49a7f9b244feca77cb', 'request_id': 'req-7b81ae34-691d-413c-a8d0-06863199355d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.297603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29260c09fcef4a49a7f9b244feca77cb', 'request_id': 'req-7b81ae34-691d-413c-a8d0-06863199355d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.312117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] The token cache is being invalidate because project 29260c09fcef4a49a7f9b244feca77cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:01.312419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.313145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b81ae34-691d-413c-a8d0-06863199355d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.314744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1076/2163] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:01 2022] DELETE /identity/v3/projects/29260c09fcef4a49a7f9b244feca77cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:01.321289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.321584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.321865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.360349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:01.362322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.501412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1088/2164] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:01.510940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.511464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.511711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.543398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:01.543398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.556314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1077/2165] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:01.563168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.582252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6061-30bc-4e77-9f08-11389748b470 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.588596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.590931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.591351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.592086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.592383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.592665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.593431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:01.593745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.595467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.609068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1089/2166] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:46:01.611788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985f0a-ea5f-4597-8919-db81995de631 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.614126 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.623069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.624031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.624318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.624602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] PATH_INFO: `/v3/users/37501fd80d5348a9a5f34bfc4b118e05` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.625998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37501fd80d5348a9a5f34bfc4b118e05)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.628249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.628412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2790cf-057e-4fc0-8484-dac594e2bd0a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.638066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.639250 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.639829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.640346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.641760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.645975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.691084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1090/2167] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:01 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:01.696985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.700415 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37501fd80d5348a9a5f34bfc4b118e05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.714486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37501fd80d5348a9a5f34bfc4b118e05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.736370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37501fd80d5348a9a5f34bfc4b118e05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.737219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37501fd80d5348a9a5f34bfc4b118e05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.737762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-063790a0-565b-4760-9e3d-15dcd88e727f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37501fd80d5348a9a5f34bfc4b118e05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:01.753012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1078/2168] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:01 2022] DELETE /identity/v3/users/37501fd80d5348a9a5f34bfc4b118e05 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:01.760120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.760472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.760718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.780401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:01.781649 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.813010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cc79-946d-48b3-a9f9-cd4bb219577d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.890786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1079/2169] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:01.906263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.908336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.909858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.910602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.910862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.911174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.916526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.919243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.952534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1091/2170] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:01 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:01.956916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.958946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:01.971887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce539c-edbb-4d9a-90f8-f2ff5fb4dd2f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.977265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.977955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:01.978261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:01.978524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:01.979275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:01.980941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:01.992550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1092/2171] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:01.994586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd9cc-821e-4704-8759-4ce216930970 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:01.996241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:01.999097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:01.999791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.000081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.000361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.009161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842bce2-7d5a-4138-92e0-eb3149ee30d2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:02.010932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.012583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.016819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:02.018497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.018497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.018766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.020105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.022885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d72d39-f6fe-466e-bd4d-c0312c179e1e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.024179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1080/2172] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:46:02.037494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1093/2173] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:02.042064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:02.051956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfee81-a108-414d-96ca-afc7e90267c1 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:02.058635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:02.059601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.059887 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.060169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] PATH_INFO: `/v3/projects/9a2c0807e3fc4161b894f123e8acc473/users/37203169f06d42c59dc670dc416caf38/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.078318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2c0807e3fc4161b894f123e8acc473, user_id=37203169f06d42c59dc670dc416caf38, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.084130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.103472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1081/2174] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:02 2022] PUT /identity/v3/projects/9a2c0807e3fc4161b894f123e8acc473/users/37203169f06d42c59dc670dc416caf38/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:02.108746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.109038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.109348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.134249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:02.135855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:02.213843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1094/2175] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:02.224181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:02.299713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7b3ea-d196-4753-a692-2f6bf3046e64 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:02.308520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:02.310200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.310878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.312205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.334758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.337514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.359913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:02.360593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1082/2176] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:02.365113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:02.388869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216edb6-f7d4-4b49-8f58-91e44066952b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:02.400332 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:02.402163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.402768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.403221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] PATH_INFO: `/v3/projects/53d3d0c1787d483187f54f75b37d469a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.405299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d3d0c1787d483187f54f75b37d469a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.407576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.479785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d3d0c1787d483187f54f75b37d469a', 'request_id': 'req-f4db7333-abf4-408a-90ce-1aa281d9e011'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.488884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d3d0c1787d483187f54f75b37d469a', 'request_id': 'req-f4db7333-abf4-408a-90ce-1aa281d9e011'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.497954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d3d0c1787d483187f54f75b37d469a', 'request_id': 'req-f4db7333-abf4-408a-90ce-1aa281d9e011'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.511847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] The token cache is being invalidate because project 53d3d0c1787d483187f54f75b37d469a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:02.512377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.512643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.514838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1095/2177] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:02 2022] DELETE /identity/v3/projects/53d3d0c1787d483187f54f75b37d469a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:02.520303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:02.538235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6acb5b-85ea-4196-bebd-8c7778c6b316 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:02.633647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:02.634817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:02.635105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:02.635409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] PATH_INFO: `/v3/users/65394faaae134873868cf06868ffb5b0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:02.636990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=65394faaae134873868cf06868ffb5b0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:02.639482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:02.707285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65394faaae134873868cf06868ffb5b0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.718688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65394faaae134873868cf06868ffb5b0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.737201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65394faaae134873868cf06868ffb5b0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.737201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65394faaae134873868cf06868ffb5b0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.737201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0fdb16b9-c01b-4ef2-a444-3239e8302fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65394faaae134873868cf06868ffb5b0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:02.758078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1083/2178] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:02 2022] DELETE /identity/v3/users/65394faaae134873868cf06868ffb5b0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:03.177339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:03.180153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.203599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7333-abf4-408a-90ce-1aa281d9e011 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:03.277022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac782-c54b-4690-b9dd-2854cdae4197 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.278873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac782-c54b-4690-b9dd-2854cdae4197 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.279583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac782-c54b-4690-b9dd-2854cdae4197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.312891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:03.314051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.314402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.314839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] PATH_INFO: `/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.315646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2a6ac782-c54b-4690-b9dd-2854cdae4197 None None] MFA Rules not processed for user `37203169f06d42c59dc670dc416caf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:03.316964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a6ac782-c54b-4690-b9dd-2854cdae4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.317395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff5a21a83294aafbccf59af6eec6bf2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:03.321087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:03.422897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff5a21a83294aafbccf59af6eec6bf2', 'request_id': 'req-3e044d03-be13-4f4e-b8f4-292d9a5686ab'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:03.430633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1084/2179] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:03.438675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5ad9-70c8-4024-9133-bf2926396d5c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.438675 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5ad9-70c8-4024-9133-bf2926396d5c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.438940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a5ad9-70c8-4024-9133-bf2926396d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.441913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff5a21a83294aafbccf59af6eec6bf2', 'request_id': 'req-3e044d03-be13-4f4e-b8f4-292d9a5686ab'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:03.461549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-277a5ad9-70c8-4024-9133-bf2926396d5c None None] MFA Rules not processed for user `f5a10f7c3b0a41ca8bd08cb83f850c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:03.463131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-277a5ad9-70c8-4024-9133-bf2926396d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.467909 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff5a21a83294aafbccf59af6eec6bf2', 'request_id': 'req-3e044d03-be13-4f4e-b8f4-292d9a5686ab'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:03.488256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] The token cache is being invalidate because project 5ff5a21a83294aafbccf59af6eec6bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:03.495788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:03.496582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:03.501631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1096/2180] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:03 2022] DELETE /identity/v3/projects/5ff5a21a83294aafbccf59af6eec6bf2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:03.501631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:03.502136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.569688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1085/2181] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:03.573142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c1d6-d1ef-42a5-9b79-1302890afbb9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.573142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c1d6-d1ef-42a5-9b79-1302890afbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.573421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c1d6-d1ef-42a5-9b79-1302890afbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.582542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e044d03-be13-4f4e-b8f4-292d9a5686ab admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:03.591541 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:03.592740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.593253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.593763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.597335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.626651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a602c1d6-d1ef-42a5-9b79-1302890afbb9 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:03.629999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a602c1d6-d1ef-42a5-9b79-1302890afbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.743734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:03.747570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:03.761656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1086/2182] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:03.775781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.776434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1097/2183] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:03.779886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.780642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.837639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:03.843609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:03.861225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1087/2184] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:03.867704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:03.885931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139f47a-6eb2-4fdd-9eac-af101bf3b11f service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:03.900378 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:03.901176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.901475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.901766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.902543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:03.902864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:03.908740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:03.937368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1098/2185] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:46:03.938738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:03.955142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112999b-78bb-483f-8e8f-ca1032e64303 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:03.964625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:03.965470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:03.965766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:03.966072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:03.966805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:03.970154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.017390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1088/2186] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:03 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:04.023537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.046136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68fc90-eedc-492e-9462-997edc96a5e3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.158819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.159956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.160406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.160900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.162650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.166123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.217312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1099/2187] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:04 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:04.221641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.259354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad80ad-81c8-4669-9e90-1204a3f0d37a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.268599 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.269470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.269761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.270042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.272064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.274251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.294035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1089/2188] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:04.299056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.319258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426c56b-0c75-4cf0-8e45-b8a9a98208f9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.324980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.325676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.325972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.326253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.327010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.328803 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447afdb-7556-4836-b4b0-6f4b53acba5b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.341684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1100/2189] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:04.345819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.358233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501df018-b3d3-4e16-94a1-55fdb942dc98 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.363164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.364222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.364512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.364815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] PATH_INFO: `/v3/projects/e4208423833e4855b621e6658f2d600f/users/404e30d9a8494f7e83a665cada46098b/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.384060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4208423833e4855b621e6658f2d600f, user_id=404e30d9a8494f7e83a665cada46098b, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.386801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.406834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1090/2190] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:04 2022] PUT /identity/v3/projects/e4208423833e4855b621e6658f2d600f/users/404e30d9a8494f7e83a665cada46098b/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:04.421093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.421416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.421802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.454763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] MFA Rules not processed for user `404e30d9a8494f7e83a665cada46098b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:04.456077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:04.573578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1101/2191] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:04.578908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.684145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8fea-b8d9-45ee-ad6b-58213064eede admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.692305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.693634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.694122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.694543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.696116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.698080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.730569 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1091/2192] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:04 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:04.734465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.747528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357464-c5b4-457f-99de-61a07a7b3729 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.849704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.849704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.849704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.849704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.851143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.852365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.877166 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1102/2193] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:04 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:04.882001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.895301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffd1b4-04f3-49d9-8e5a-92589613de68 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.901766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.902575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.903006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.903517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.904516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.906516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.927278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1092/2194] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:04.928895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:04.947692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31411f6e-277a-46a7-9e3d-dfbd7ccd3e18 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:04.955784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:04.956799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:04.957299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:04.957782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:04.958737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:04.962452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f07c-7b97-4f03-b842-c05a8af8d976 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:04.983849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1103/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:04.988913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.004193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ed643-b7d4-42a0-8800-e7de610e77cf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.010765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.012387 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.012889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.013375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] PATH_INFO: `/v3/projects/f5553d94014f46ce8dbe7de9d0dc2e1e/users/e9dcba4ca2ba4c18a04fa3cc40603b79/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.041513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5553d94014f46ce8dbe7de9d0dc2e1e, user_id=e9dcba4ca2ba4c18a04fa3cc40603b79, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.045135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.062891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1093/2196] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:04 2022] PUT /identity/v3/projects/f5553d94014f46ce8dbe7de9d0dc2e1e/users/e9dcba4ca2ba4c18a04fa3cc40603b79/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:05.075194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.075531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.075824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.118787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] MFA Rules not processed for user `e9dcba4ca2ba4c18a04fa3cc40603b79`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:05.120100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:05.190278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1104/2197] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:05.196145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.258594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7bfd-6b60-459b-a2ca-470e09de2008 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.264141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.264981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.266383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.266383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.266383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.268388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.313204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1094/2198] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:05 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:05.318811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.332549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f2449-caa4-4983-8918-911d3bab95bf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.392769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.393368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.393658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.393939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.394653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.397863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.423673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1105/2199] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:05 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:05.428398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.438886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcfd5a-ce12-4a59-93a1-804851a61a40 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.443880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.444561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.444848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.445125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.446126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.447768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.459495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1095/2200] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:05.463854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.476524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf611-7261-4719-85d4-fa304c310989 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.482343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.483585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.483876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.484152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] PATH_INFO: `/v3/projects/794fe149b2c9406b8b92519d647f6e02/users/b4379f9f7d8a4f82933fd56ea9a15f57/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.512746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794fe149b2c9406b8b92519d647f6e02, user_id=b4379f9f7d8a4f82933fd56ea9a15f57, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.517232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.532720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1106/2201] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:05 2022] PUT /identity/v3/projects/794fe149b2c9406b8b92519d647f6e02/users/b4379f9f7d8a4f82933fd56ea9a15f57/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:05.538116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.548276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb65fe-b9e3-482c-8962-0c3198bdf4c6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.625274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.627073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.627073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.627073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.628504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.631774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf520e2-febd-42e5-b2bb-fef1ab073ef3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.656051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1096/2202] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:05.658546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.670577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081240-a908-4845-a99e-0a014dfdaea7 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.675684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.676653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.677097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.677385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] PATH_INFO: `/v3/projects/794fe149b2c9406b8b92519d647f6e02/users/b4379f9f7d8a4f82933fd56ea9a15f57/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.680417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794fe149b2c9406b8b92519d647f6e02, user_id=b4379f9f7d8a4f82933fd56ea9a15f57, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.683174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.704110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1107/2203] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:05 2022] PUT /identity/v3/projects/794fe149b2c9406b8b92519d647f6e02/users/b4379f9f7d8a4f82933fd56ea9a15f57/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:05.722685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.723091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.723473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.766470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] MFA Rules not processed for user `b4379f9f7d8a4f82933fd56ea9a15f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:05.768466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:05.859217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1097/2204] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:05.876634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:05.939028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08950538-3946-43aa-a1cf-b790c8ea73d1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:05.942869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:05.944264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:05.944550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:05.944827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:05.955095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:05.956601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9aa7c-c1d9-4544-b8ff-58463fc120cf service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:05.967456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1108/2205] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:06.465914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:06.476009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736746d-c7c4-4841-959e-c7287fa351db None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:06.479582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:06.480221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:06.480505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:06.480779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:06.536299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:06.538398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:06.547184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1098/2206] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:09.532682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6c4c-d312-438e-ac5e-8bafd37cc015 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:09.533335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6c4c-d312-438e-ac5e-8bafd37cc015 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:09.533467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6c4c-d312-438e-ac5e-8bafd37cc015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:09.556621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-02aa6c4c-d312-438e-ac5e-8bafd37cc015 None None] MFA Rules not processed for user `37203169f06d42c59dc670dc416caf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:09.557832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-02aa6c4c-d312-438e-ac5e-8bafd37cc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:09.615942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1109/2207] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:11.447397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:11.450083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:11.566437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732e98e-d2a4-4bcd-81d9-dbb9aa93f2a8 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:11.572814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:11.573817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:11.574179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:11.574520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] PATH_INFO: `/v3/users/e09eafe3c75b4d3ab9d285c6c92c4b9e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:11.575847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09eafe3c75b4d3ab9d285c6c92c4b9e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:11.577880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:11.629992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09eafe3c75b4d3ab9d285c6c92c4b9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:11.639832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09eafe3c75b4d3ab9d285c6c92c4b9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:11.655274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09eafe3c75b4d3ab9d285c6c92c4b9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:11.656039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09eafe3c75b4d3ab9d285c6c92c4b9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:11.656713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09eafe3c75b4d3ab9d285c6c92c4b9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:11.671348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1099/2208] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:11 2022] DELETE /identity/v3/users/e09eafe3c75b4d3ab9d285c6c92c4b9e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:11.675904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:11.676417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:11.676665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:11.696123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:11.698233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:11.780485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1110/2209] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:11.791110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:11.792686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:11.852430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633deca-0d74-4133-a72a-99036b37410c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:11.856998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:11.857664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:11.857954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:11.858233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:11.869774 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:11.871244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae1f6f-c372-4e22-89f3-4a1961d5e9fe service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:11.881465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1100/2210] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:11.947880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:11.949900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:11.963524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2676dc-1e7d-4300-8879-d7a669a4d1c6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:11.969232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:11.970207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:11.970571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:11.970965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] PATH_INFO: `/v3/users/75ef29d31d3e48ee9bc61b9a1fe111ec` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:11.972405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ef29d31d3e48ee9bc61b9a1fe111ec)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:11.974739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.027705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ef29d31d3e48ee9bc61b9a1fe111ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.028409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ef29d31d3e48ee9bc61b9a1fe111ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.042312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ef29d31d3e48ee9bc61b9a1fe111ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.043136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ef29d31d3e48ee9bc61b9a1fe111ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.052260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ef29d31d3e48ee9bc61b9a1fe111ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.065349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1111/2211] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:11 2022] DELETE /identity/v3/users/75ef29d31d3e48ee9bc61b9a1fe111ec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:12.069713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.070015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.070300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.088383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:12.089730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.156375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1101/2212] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:12.166205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.167718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.225584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7def80-e5e8-4e08-8ce7-7226044be4dc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.230441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.231299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.231763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.232110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.240718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.242386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.242701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.244863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.256212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1112/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:12.260464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9156e12-9a87-4504-aeb0-c951f52125e5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.266283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.267482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.267678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.267995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] PATH_INFO: `/v3/projects/265cc4d4d611424d99c0c0fdcd591943` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.269315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265cc4d4d611424d99c0c0fdcd591943)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.271783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.320626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265cc4d4d611424d99c0c0fdcd591943', 'request_id': 'req-80f7256d-b5d2-4db3-82ad-1856b462d386'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.328767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265cc4d4d611424d99c0c0fdcd591943', 'request_id': 'req-80f7256d-b5d2-4db3-82ad-1856b462d386'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.337575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265cc4d4d611424d99c0c0fdcd591943', 'request_id': 'req-80f7256d-b5d2-4db3-82ad-1856b462d386'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.348355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] The token cache is being invalidate because project 265cc4d4d611424d99c0c0fdcd591943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:12.348644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.349313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.350902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1102/2214] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:12 2022] DELETE /identity/v3/projects/265cc4d4d611424d99c0c0fdcd591943 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:12.354886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.365867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb3c2a-944a-4cf0-822a-556e52d1d18b service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.433598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.434482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.434802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.435230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] PATH_INFO: `/v3/users/b48f4352fca6413c8207599caa5e9ade` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.436517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48f4352fca6413c8207599caa5e9ade)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.438476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.484433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48f4352fca6413c8207599caa5e9ade'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.485113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48f4352fca6413c8207599caa5e9ade'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.496584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48f4352fca6413c8207599caa5e9ade'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.497274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48f4352fca6413c8207599caa5e9ade'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.504885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4ca7366e-ce39-4baa-9246-b8ef3943acd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48f4352fca6413c8207599caa5e9ade'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.518928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1113/2215] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:12 2022] DELETE /identity/v3/users/b48f4352fca6413c8207599caa5e9ade => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:12.559837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.561330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.576650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7256d-b5d2-4db3-82ad-1856b462d386 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.642993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.644044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.644335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.644632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] PATH_INFO: `/v3/projects/d4d2549d6aec4acebc397538107d5ffd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.645859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d2549d6aec4acebc397538107d5ffd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.647839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.702042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d2549d6aec4acebc397538107d5ffd', 'request_id': 'req-2024e364-d2a6-4001-b249-49edc132ed9f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.709933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d2549d6aec4acebc397538107d5ffd', 'request_id': 'req-2024e364-d2a6-4001-b249-49edc132ed9f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.720719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d2549d6aec4acebc397538107d5ffd', 'request_id': 'req-2024e364-d2a6-4001-b249-49edc132ed9f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.734634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] The token cache is being invalidate because project d4d2549d6aec4acebc397538107d5ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:12.734967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.735777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:12.739034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1103/2216] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:12 2022] DELETE /identity/v3/projects/d4d2549d6aec4acebc397538107d5ffd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:12.745033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0e42-1298-4883-91ae-1681c9b26b4d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.745449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0e42-1298-4883-91ae-1681c9b26b4d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.745595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd0e42-1298-4883-91ae-1681c9b26b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.777153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-58cd0e42-1298-4883-91ae-1681c9b26b4d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:12.779777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-58cd0e42-1298-4883-91ae-1681c9b26b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.807144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.809298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.891923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1114/2217] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:12.897727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e364-d2a6-4001-b249-49edc132ed9f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.899186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.899728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.900001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.902531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.903262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.903603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.903878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.905692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.920346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:12.921608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:12.932687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1115/2218] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:12.936808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.950439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b7b9-13f9-4f1c-b363-40b9de6dec8a None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:12.958439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:12.959123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:12.959462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:12.959708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:12.960648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:12.960967 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.962901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.979265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1116/2219] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:46:12.985001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:12.993871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:12.995858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:12.999762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8585845-4e71-407e-8d45-c073be7e515a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.006549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.007651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.007993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.008302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.009222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.010796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1104/2220] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:13.012311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.021062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.022732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:13.058892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1117/2221] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:13.060660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.070129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4955911-d25d-4e61-9dff-7efb893342f8 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.145749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03caf5-df5b-4c2e-9ec4-85eac8e45641 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.153607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.154990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.155978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.155978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.156679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.158828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.184221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.185236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.185426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.186067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] PATH_INFO: `/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.187459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f7f3ac34124f3fb7480edd2a9c9082)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.189677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1118/2222] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:13.190125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.193623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.206483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d85ec-229b-40c1-b1e5-df40cd90b668 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.213312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.214142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.214519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.214867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.215745 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.217576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.231452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1119/2223] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:13.236979 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.250865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d902d1-ce7b-4900-8b23-6eb5eb220c2b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.268493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f7f3ac34124f3fb7480edd2a9c9082', 'request_id': 'req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:13.277845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f7f3ac34124f3fb7480edd2a9c9082', 'request_id': 'req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:13.291177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f7f3ac34124f3fb7480edd2a9c9082', 'request_id': 'req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:13.312695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] The token cache is being invalidate because project 97f7f3ac34124f3fb7480edd2a9c9082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:13.313093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:13.314255 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1b0b65f-7f23-4b92-9f45-ac9b3d688c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:13.317605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1105/2224] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:13 2022] DELETE /identity/v3/projects/97f7f3ac34124f3fb7480edd2a9c9082 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:13.325223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927dd9-939b-47bf-a173-1e9b681f9b31 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.326406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927dd9-939b-47bf-a173-1e9b681f9b31 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.326828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927dd9-939b-47bf-a173-1e9b681f9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.334223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.335174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.335666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.336119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.337728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.340145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.355533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-12927dd9-939b-47bf-a173-1e9b681f9b31 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:13.356981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12927dd9-939b-47bf-a173-1e9b681f9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:13.359165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1120/2225] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:13.364059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.367235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:13.371407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1106/2226] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:13.380749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.381231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.381783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.386646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf1e14-4a5d-44db-96c8-cd73c152b609 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.394414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.395339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.395652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.396149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] PATH_INFO: `/v3/projects/f8566222aa2b47dea801ebd6fb1eabef/users/4ac83e73851f4592aaa09b38deabe5ad/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.404506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:13.405985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:13.419445 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1107/2227] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:13.421034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8566222aa2b47dea801ebd6fb1eabef, user_id=4ac83e73851f4592aaa09b38deabe5ad, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.423765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.424349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cf833-d7c0-4e6c-94eb-149ff61906ac admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.439146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b7e5-12fd-4c45-bdb6-5f28e35f94bf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.445668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1121/2228] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:13 2022] PUT /identity/v3/projects/f8566222aa2b47dea801ebd6fb1eabef/users/4ac83e73851f4592aaa09b38deabe5ad/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:13.458298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.458651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.458930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.489534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] MFA Rules not processed for user `4ac83e73851f4592aaa09b38deabe5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:13.490823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:13.513983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.515016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.515153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.515458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.516355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:13.516706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.518705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.535498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1108/2229] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:46:13.540692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.551870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec710-eed0-4636-a92b-fd1824c78017 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.557391 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.558325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.558677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.559137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.559862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.562137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.587399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1122/2230] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:13.588908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.599888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1109/2231] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:13.600410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a1d1-5e3c-4283-9779-a7b6e543f30c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.606646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.669050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.669730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.670288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.670288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.670995 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.673526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.687282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b322-6352-4078-9018-8bf336b96a71 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.695507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.697299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.697590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.697971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.698694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.700743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.721477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1123/2232] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:13.725466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.726855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1110/2233] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:13.732631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.750446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081302-c4aa-4191-aca9-b80064d10e33 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.812662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a684d-1086-4ff2-bca4-4c379394c1c3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.817867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.818578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.818870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.819155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.819914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.822850 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.856588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.857297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.857588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.857873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.858069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1124/2234] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:13 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:13.858623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.860403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.861945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.872336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1111/2235] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:13.877715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.878702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2471-c0b9-413a-a79c-670b7383e02a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.886168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.886934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.887212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.887557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.888303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.890350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.892129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086f503-1cb3-4395-9465-289bef62bb6c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.896869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.897558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.897851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.898634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.898879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.901247 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.902930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1125/2236] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:13.909868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.919813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1112/2237] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:46:13.920273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d48c0-6e3a-4f4b-afe8-ba22a1d54135 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.923814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.925994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.926928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.927224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.927547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] PATH_INFO: `/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb/users/a426b9aee8bc49b48bcb385b35ad5b67/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.936427 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d4a1f-4e6c-4a10-8620-577a89fd2d38 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:13.941804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:13.942935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:13.943232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:13.943564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] PATH_INFO: `/v3/projects/ca32183b861c4d11aabf502461bf528a/users/f30b6168cc3844cb89cecc2600aed677/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:13.951718 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a68a6df7d4d119eace5a3b42c51cb, user_id=a426b9aee8bc49b48bcb385b35ad5b67, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.957778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.962611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca32183b861c4d11aabf502461bf528a, user_id=f30b6168cc3844cb89cecc2600aed677, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:13.965466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf404c5d-1565-4442-81ac-3e59c4e4b3fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:13.982963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1126/2238] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:13 2022] PUT /identity/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb/users/a426b9aee8bc49b48bcb385b35ad5b67/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:13.987333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:13.999470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1113/2239] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:13 2022] PUT /identity/v3/projects/ca32183b861c4d11aabf502461bf528a/users/f30b6168cc3844cb89cecc2600aed677/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:14.008052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.008370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.009417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.042074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] MFA Rules not processed for user `f30b6168cc3844cb89cecc2600aed677`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:14.052180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:14.086381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d2913-b2a6-4f67-9a5a-779f2b2c81f0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:14.145863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1114/2240] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:14.154688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:14.156079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.156079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.156079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.157043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:14.158402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:14.158672 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:14.161299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:14.173410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1127/2241] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:14.175076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:14.187227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9b50b-5a74-4acb-91ca-08b097e3e9fe admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:14.193737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:14.194819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.194960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.195472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] PATH_INFO: `/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb/users/a426b9aee8bc49b48bcb385b35ad5b67/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.198790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e10a68a6df7d4d119eace5a3b42c51cb, user_id=a426b9aee8bc49b48bcb385b35ad5b67, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:14.201804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e2d3d-7adc-467c-9112-bd04ac6d2be5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:14.225476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1128/2242] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:14 2022] PUT /identity/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb/users/a426b9aee8bc49b48bcb385b35ad5b67/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:14.228431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.228800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.229221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.244345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b23b7-3f39-4d89-b548-96a9ef5950e5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:14.261914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] MFA Rules not processed for user `a426b9aee8bc49b48bcb385b35ad5b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:14.263148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:14.301888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:14.302560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.302850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.303132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.370974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:14.372892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:14.385184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1115/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:14.386098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1129/2244] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:14.406003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:14.407891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:14.426263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc42e-8492-4294-969f-0d2328624ba9 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:14.434561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:14.436276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:14.439828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:14.439828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:14.595605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:14.598794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2abfc-1f5e-40c3-b1f7-0645aa79b36b service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:14.624385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1116/2245] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:15.623500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:15.625182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:15.696822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da8977-b577-42a6-983e-9739f0f99c4f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:15.702028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:15.702927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:15.703241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:15.703550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] PATH_INFO: `/v3/users/404e30d9a8494f7e83a665cada46098b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:15.704768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404e30d9a8494f7e83a665cada46098b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:15.706710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:15.762795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404e30d9a8494f7e83a665cada46098b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:15.763861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404e30d9a8494f7e83a665cada46098b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:15.782148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404e30d9a8494f7e83a665cada46098b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:15.782904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404e30d9a8494f7e83a665cada46098b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:15.797603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404e30d9a8494f7e83a665cada46098b'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:15.822395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1130/2246] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:15 2022] DELETE /identity/v3/users/404e30d9a8494f7e83a665cada46098b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:15.825813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:15.826382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:15.827428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:15.859318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:15.860604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:15.947708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1117/2247] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:15.961816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:15.965294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:16.043880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa3bdd-a352-4509-9baf-882dda5b9647 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:16.047547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:16.048205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:16.048490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:16.048765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:16.058997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:16.060489 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:16.070276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1131/2248] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:16.687837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:16.689363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:16.710561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64bf3e-33d4-46f2-a95a-db5816bbd934 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:16.718919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:16.720106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:16.720252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:16.720458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] PATH_INFO: `/v3/projects/e4208423833e4855b621e6658f2d600f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:16.721702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4208423833e4855b621e6658f2d600f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:16.723872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:16.778405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4208423833e4855b621e6658f2d600f', 'request_id': 'req-c4549e75-6393-433a-87d3-c16b35f04cc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.784795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4208423833e4855b621e6658f2d600f', 'request_id': 'req-c4549e75-6393-433a-87d3-c16b35f04cc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.792797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4208423833e4855b621e6658f2d600f', 'request_id': 'req-c4549e75-6393-433a-87d3-c16b35f04cc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.802685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] The token cache is being invalidate because project e4208423833e4855b621e6658f2d600f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:16.802969 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.803617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.805151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1118/2249] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:16 2022] DELETE /identity/v3/projects/e4208423833e4855b621e6658f2d600f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:16.809638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:16.819682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941f03c-243f-4cad-adb9-62e31826499e service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:16.876524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:16.877403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:16.877685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:16.877960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] PATH_INFO: `/v3/users/e9dcba4ca2ba4c18a04fa3cc40603b79` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:16.879150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9dcba4ca2ba4c18a04fa3cc40603b79)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:16.881108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:16.928724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9dcba4ca2ba4c18a04fa3cc40603b79'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.929389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9dcba4ca2ba4c18a04fa3cc40603b79'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.941554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9dcba4ca2ba4c18a04fa3cc40603b79'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.942208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9dcba4ca2ba4c18a04fa3cc40603b79'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.949604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9dcba4ca2ba4c18a04fa3cc40603b79'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:16.961804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1132/2250] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:16 2022] DELETE /identity/v3/users/e9dcba4ca2ba4c18a04fa3cc40603b79 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:17.341194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:17.346104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:17.364224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4549e75-6393-433a-87d3-c16b35f04cc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:17.436543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:17.437528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:17.438086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:17.438662 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] PATH_INFO: `/v3/projects/f5553d94014f46ce8dbe7de9d0dc2e1e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:17.439960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5553d94014f46ce8dbe7de9d0dc2e1e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:17.441893 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:17.537372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5553d94014f46ce8dbe7de9d0dc2e1e', 'request_id': 'req-fa01411c-3f47-4fb9-93fc-257b4fa05feb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.544269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5553d94014f46ce8dbe7de9d0dc2e1e', 'request_id': 'req-fa01411c-3f47-4fb9-93fc-257b4fa05feb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.552744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5553d94014f46ce8dbe7de9d0dc2e1e', 'request_id': 'req-fa01411c-3f47-4fb9-93fc-257b4fa05feb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.564712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] The token cache is being invalidate because project f5553d94014f46ce8dbe7de9d0dc2e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:17.565268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.565941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.567526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1119/2251] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:17 2022] DELETE /identity/v3/projects/f5553d94014f46ce8dbe7de9d0dc2e1e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:17.572712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:17.574125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:17.588459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af468e3-fa78-405f-97eb-4f80a973bd96 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:17.647285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:17.648218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:17.648513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:17.648798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] PATH_INFO: `/v3/users/b4379f9f7d8a4f82933fd56ea9a15f57` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:17.651262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4379f9f7d8a4f82933fd56ea9a15f57)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:17.653320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:17.700810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4379f9f7d8a4f82933fd56ea9a15f57'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.701479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4379f9f7d8a4f82933fd56ea9a15f57'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.714434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4379f9f7d8a4f82933fd56ea9a15f57'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.715066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4379f9f7d8a4f82933fd56ea9a15f57'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.725040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d887e9af-63e4-4c5c-865c-7eeba5a1361d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4379f9f7d8a4f82933fd56ea9a15f57'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:17.739205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1133/2252] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:17 2022] DELETE /identity/v3/users/b4379f9f7d8a4f82933fd56ea9a15f57 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:18.068042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.069658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:18.090166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01411c-3f47-4fb9-93fc-257b4fa05feb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.150907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.151816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.152106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.152388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] PATH_INFO: `/v3/projects/794fe149b2c9406b8b92519d647f6e02` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.153623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=794fe149b2c9406b8b92519d647f6e02)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.155650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.204912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794fe149b2c9406b8b92519d647f6e02', 'request_id': 'req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:18.210846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794fe149b2c9406b8b92519d647f6e02', 'request_id': 'req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:18.224354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794fe149b2c9406b8b92519d647f6e02', 'request_id': 'req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:18.235808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] The token cache is being invalidate because project 794fe149b2c9406b8b92519d647f6e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:18.236107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:18.236853 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fb4ce6dc-b2b7-4006-a460-0b893743a7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:18.238443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1120/2253] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:18 2022] DELETE /identity/v3/projects/794fe149b2c9406b8b92519d647f6e02 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:18.247252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.247762 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.247879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.272216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:18.273444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:18.336047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1134/2254] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:18.345193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.345996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.345996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.366414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:18.368390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:18.377278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1121/2255] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:18.382282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.392144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7873-26aa-4a3f-bae1-47ea359673e1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.397131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.397831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.398115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.398395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.399602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:18.399917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.401562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.418347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1135/2256] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:46:18.419788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.433526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb51a-2907-4370-8554-6128630d8c88 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.438583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.439759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.440124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.440488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.441314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.443553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.471661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1122/2257] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:18 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:18.475857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.486855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad29c2-6b74-48df-b631-809692750857 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.547656 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.548350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.548638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.548949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.549728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.551760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.573316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1136/2258] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:18 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:18.577468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.589423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504a4a-13df-471e-be3f-db68a2c64d9e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.594471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.595157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.595481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.595859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.597104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.598129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.613241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1123/2259] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:18.614443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.624561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a115a6-9e97-482b-9d60-f048f2e82548 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.629721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.630305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.630595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.630875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.631647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.633296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa16c6-1372-497c-aa1a-ea54aaecc21a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.643222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1137/2260] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:18.647472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.658069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b044a-bb10-4489-8dd7-93cf818bc52f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.665770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.666953 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.667248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.667603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] PATH_INFO: `/v3/projects/3cb94ed3e4d34bad83c3ca18e3516b34/users/6fd5d998128f41e9b4b1d0218914237a/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.683521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb94ed3e4d34bad83c3ca18e3516b34, user_id=6fd5d998128f41e9b4b1d0218914237a, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.686196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.699405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1124/2261] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:18 2022] PUT /identity/v3/projects/3cb94ed3e4d34bad83c3ca18e3516b34/users/6fd5d998128f41e9b4b1d0218914237a/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:18.710569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.710954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.711242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.739398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] MFA Rules not processed for user `6fd5d998128f41e9b4b1d0218914237a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:18.740515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:18.812333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1138/2262] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:18.824201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:18.825991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:18.884062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f142e-78cb-4423-bcb3-b3f0b67cc376 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:18.887829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:18.888479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:18.888766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:18.889045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:18.897580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:18.899116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bf41d-322d-4eb0-a7d9-1b9598658575 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:18.915278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1125/2263] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:23.859552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:23.860994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:23.928408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c0b1a-357e-4538-b3b0-092ac3cfaf09 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:23.934613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:23.935564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:23.935864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:23.936150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] PATH_INFO: `/v3/users/4ac83e73851f4592aaa09b38deabe5ad` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:23.937502 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac83e73851f4592aaa09b38deabe5ad)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:23.939469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:23.996758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac83e73851f4592aaa09b38deabe5ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:23.997478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac83e73851f4592aaa09b38deabe5ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.012125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac83e73851f4592aaa09b38deabe5ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.012785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac83e73851f4592aaa09b38deabe5ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.020897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac83e73851f4592aaa09b38deabe5ad'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.038146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1139/2264] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:23 2022] DELETE /identity/v3/users/4ac83e73851f4592aaa09b38deabe5ad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:24.043194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:24.043776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:24.043776 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:24.061040 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:24.062224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:24.118421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1126/2265] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:24.128329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:24.130029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:24.194459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7630c-d2f0-4275-ab39-16511ced1270 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:24.200449 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:24.201316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:24.201959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:24.202333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:24.218207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:24.220810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:24.238534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1140/2266] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:24.519217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:24.522407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:24.549270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d393f-c0fb-4712-bfbf-a1a010207b1f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:24.560368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:24.561903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:24.562388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:24.562844 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] PATH_INFO: `/v3/projects/f8566222aa2b47dea801ebd6fb1eabef` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:24.564140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8566222aa2b47dea801ebd6fb1eabef)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:24.566621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:24.620431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8566222aa2b47dea801ebd6fb1eabef', 'request_id': 'req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.626645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8566222aa2b47dea801ebd6fb1eabef', 'request_id': 'req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.634073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8566222aa2b47dea801ebd6fb1eabef', 'request_id': 'req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.645780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] The token cache is being invalidate because project f8566222aa2b47dea801ebd6fb1eabef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:24.646084 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.646749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.648359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1127/2267] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:24 2022] DELETE /identity/v3/projects/f8566222aa2b47dea801ebd6fb1eabef => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:24.653058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:24.662682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e14f-413f-4087-b241-a58fb8eb4d27 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:24.720956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:24.721852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:24.722139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:24.722417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] PATH_INFO: `/v3/users/a426b9aee8bc49b48bcb385b35ad5b67` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:24.723696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a426b9aee8bc49b48bcb385b35ad5b67)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:24.725572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:24.769832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a426b9aee8bc49b48bcb385b35ad5b67'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.770508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a426b9aee8bc49b48bcb385b35ad5b67'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.788440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a426b9aee8bc49b48bcb385b35ad5b67'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.790913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a426b9aee8bc49b48bcb385b35ad5b67'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.800346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-128b952e-616c-43cf-9499-13073c3d1e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a426b9aee8bc49b48bcb385b35ad5b67'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:24.823027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1141/2268] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:24 2022] DELETE /identity/v3/users/a426b9aee8bc49b48bcb385b35ad5b67 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:25.193448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.195037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:25.209827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9ea9-8f51-40e4-a6a8-01e0abfbd9a8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.285574 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.286437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.286722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.287001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] PATH_INFO: `/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.288258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e10a68a6df7d4d119eace5a3b42c51cb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.290296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.343192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10a68a6df7d4d119eace5a3b42c51cb', 'request_id': 'req-01532501-12ae-49c3-a162-d31b775a0b94'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:25.349582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10a68a6df7d4d119eace5a3b42c51cb', 'request_id': 'req-01532501-12ae-49c3-a162-d31b775a0b94'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:25.357083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10a68a6df7d4d119eace5a3b42c51cb', 'request_id': 'req-01532501-12ae-49c3-a162-d31b775a0b94'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:25.367238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] The token cache is being invalidate because project e10a68a6df7d4d119eace5a3b42c51cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:25.368105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:25.368762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01532501-12ae-49c3-a162-d31b775a0b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:25.370318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1128/2269] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:25 2022] DELETE /identity/v3/projects/e10a68a6df7d4d119eace5a3b42c51cb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:25.375516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.376000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.376094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.397120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:25.398396 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:25.464941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1142/2270] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:25.474220 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.474514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.474797 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.494077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:25.495406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:25.505123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1129/2271] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:25.510973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.521063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c75b3a-83b2-4e34-b9a5-b50e5760983f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.525727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.526403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.526670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.526942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.527707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:25.528015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.529633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.540871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1143/2272] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:46:25.545329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.554488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ee209-a8ba-4c59-9482-d69a74bf0350 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.559753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.560406 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.560693 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.560974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.561684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.563631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.589010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1130/2273] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:25 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:25.600561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.611919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2ffe7-c434-481c-89ad-122345c04b3d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.705874 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.706804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.707144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.707466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.708285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.710568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.738508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1144/2274] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:25 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:25.744060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.756283 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f427eb-28eb-45af-9c82-9b29849290fe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.761540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.762256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.762549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.762828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.763652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.765350 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.776378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1131/2275] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:25.780270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.790689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870de5f-5d8a-4200-90bb-0a5ff6c33a4c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.795335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.796090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.796399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.796662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.797397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.798982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfa39b-caec-4362-a52f-92c1ff324d39 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.809840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1145/2276] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:25.814052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:25.824550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4117a-24c4-4a3b-be66-72b5c578aac6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:25.832171 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:25.833110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.833394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.833683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] PATH_INFO: `/v3/projects/4ee19d4a413f415f852c05a51f0c44de/users/32374a909cc44bb0b22876789037060c/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.864357 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee19d4a413f415f852c05a51f0c44de, user_id=32374a909cc44bb0b22876789037060c, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:25.867355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:25.882563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1132/2277] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:25 2022] PUT /identity/v3/projects/4ee19d4a413f415f852c05a51f0c44de/users/32374a909cc44bb0b22876789037060c/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:46:25.893525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:25.893821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:25.894114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:25.920657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] MFA Rules not processed for user `32374a909cc44bb0b22876789037060c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:25.921854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:25.986320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1146/2278] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:25.998605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:26.000419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:26.068560 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3aedb-92e0-4247-aa0c-687a33ca9552 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:26.072907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:26.073575 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:26.073886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:26.074169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:26.083326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:26.084803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b14951-61bf-42cd-bf78-8cc26d27674b service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:26.094517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1133/2279] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:29.957755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:29.959305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.024139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a83ac-1125-4b99-ac45-082ad09b1d48 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:30.028609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:30.029473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.029757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.030033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] PATH_INFO: `/v3/users/6fd5d998128f41e9b4b1d0218914237a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.031221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd5d998128f41e9b4b1d0218914237a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:30.033173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:30.088939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd5d998128f41e9b4b1d0218914237a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.089668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd5d998128f41e9b4b1d0218914237a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.101125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd5d998128f41e9b4b1d0218914237a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.102314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd5d998128f41e9b4b1d0218914237a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.110407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd5d998128f41e9b4b1d0218914237a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.124242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1147/2280] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:29 2022] DELETE /identity/v3/users/6fd5d998128f41e9b4b1d0218914237a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:30.128838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.129310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.129424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.148915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:30.149995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.213110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1134/2281] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:30.222770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:30.224210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.303043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93bf62-32b2-4c94-8f00-be589c0de123 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:30.310717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:30.311883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.312370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.312836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.327300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:30.328823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e418-8eb5-4103-a6f3-d2b9c88a413c service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:30.339002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1148/2282] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:30.647288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:30.650340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.683704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813ed5-3b64-440b-a1da-398208d8c8e0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:30.705322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:30.706207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.706494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.706796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] PATH_INFO: `/v3/projects/3cb94ed3e4d34bad83c3ca18e3516b34` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.708018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb94ed3e4d34bad83c3ca18e3516b34)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:30.710028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:30.766410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb94ed3e4d34bad83c3ca18e3516b34', 'request_id': 'req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.776230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb94ed3e4d34bad83c3ca18e3516b34', 'request_id': 'req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.785367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb94ed3e4d34bad83c3ca18e3516b34', 'request_id': 'req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.800500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] The token cache is being invalidate because project 3cb94ed3e4d34bad83c3ca18e3516b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:30.801343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.802310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-efc82d2f-4e60-4f29-aa7a-e218a0a7fff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:30.804155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1135/2283] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:30 2022] DELETE /identity/v3/projects/3cb94ed3e4d34bad83c3ca18e3516b34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:30.809544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.809908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.810405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.837182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:30.839228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.923134 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1149/2284] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:46:30.941192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:30.941488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:30.941773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:30.967872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:30.974511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:30.979845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1136/2285] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:30.984917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:30.995072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b057-0764-4069-b563-47c53d01b0bf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.008419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.009193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.009678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.009963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.010713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:46:31.011028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.012686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.027410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1150/2286] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:46:31.031684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.041435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237276dd-0a88-4c35-874e-1fedf374985c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.046183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.046842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.047124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.047432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.048143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.050050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.079401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1137/2287] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:46:31 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:46:31.081581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.092385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247f160-7fe6-403d-929d-fa286408a329 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.146774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.147350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.147800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.147948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.149443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.151258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.171779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1151/2288] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:46:31 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:46:31.177888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.194050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a279312-daf3-4756-acee-5b9102e4f7a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.202054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.203074 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.203537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.203979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.205113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.207715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.223086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1138/2289] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:31.226640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.236840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f16db-5294-4e6d-8522-ed98e40ecd67 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.241635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.242503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.242703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.242917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.243765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.245370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059c4ce-00cc-4f27-bde8-dd49f01639bf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.255391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1152/2290] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:46:31.260225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.270252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae177778-e96f-4f3d-b6d6-4fb8e4c6a007 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.276022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.276923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.277212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.277495 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] PATH_INFO: `/v3/projects/6126496c6e17480cafcf3de24249611a/users/f59e298554b04f5fb08080453b7d7f26/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.293641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6126496c6e17480cafcf3de24249611a, user_id=f59e298554b04f5fb08080453b7d7f26, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.296376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.310110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1139/2291] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:46:31 2022] PUT /identity/v3/projects/6126496c6e17480cafcf3de24249611a/users/f59e298554b04f5fb08080453b7d7f26/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:31.322446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.322748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.323031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.350499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] MFA Rules not processed for user `f59e298554b04f5fb08080453b7d7f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:31.351793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:31.418273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1153/2292] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:31.430293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:31.432742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:31.501727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b969e-93ed-43cc-8ca7-71fd78ab11d6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:31.505568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:31.506228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:31.506519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:31.506803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:31.517303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:31.519456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301ac3f-ca4e-4b44-916b-d732acc07a45 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:31.529561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1140/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:46:50.603028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:50.604695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:50.784930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786a3c9-a7ea-4427-ae12-c985b02d21ae None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:50.793525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:50.795019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:50.795554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:50.796051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] PATH_INFO: `/v3/users/f30b6168cc3844cb89cecc2600aed677` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:50.797433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30b6168cc3844cb89cecc2600aed677)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:50.799862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:50.870044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30b6168cc3844cb89cecc2600aed677'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:50.870854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30b6168cc3844cb89cecc2600aed677'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:50.885900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30b6168cc3844cb89cecc2600aed677'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:50.886893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30b6168cc3844cb89cecc2600aed677'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:50.911418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30b6168cc3844cb89cecc2600aed677'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:50.925274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1154/2294] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:46:50 2022] DELETE /identity/v3/users/f30b6168cc3844cb89cecc2600aed677 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:50.930293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:50.930861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:50.930861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:50.967588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:50.969221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:51.093393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1141/2295] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:46:51.121091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:51.123186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:51.249785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1c5ed-db83-4508-8d87-5fb79c1371a8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:51.255550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:51.258048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:51.258048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:51.262696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:51.278096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:51.279621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ead0c-1899-4254-b1ee-95a74afd4add service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:51.299624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1155/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:46:51.660484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:46:51.662065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:51.681417 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ae600-e694-4e17-9745-e601b3afaed5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:46:51.689416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:46:51.690471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:51.690876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:51.691249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] PATH_INFO: `/v3/projects/ca32183b861c4d11aabf502461bf528a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:51.692697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca32183b861c4d11aabf502461bf528a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:46:51.694864 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:46:51.743049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca32183b861c4d11aabf502461bf528a', 'request_id': 'req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:51.750971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca32183b861c4d11aabf502461bf528a', 'request_id': 'req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:51.759269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca32183b861c4d11aabf502461bf528a', 'request_id': 'req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:51.775548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] The token cache is being invalidate because project ca32183b861c4d11aabf502461bf528a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:46:51.775875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:51.777079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:46:51.783543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1142/2297] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:46:51 2022] DELETE /identity/v3/projects/ca32183b861c4d11aabf502461bf528a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:46:54.221536 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e99f0f-1ff8-4a33-b696-642d7d39130c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:46:54.222050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e99f0f-1ff8-4a33-b696-642d7d39130c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:46:54.222050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e99f0f-1ff8-4a33-b696-642d7d39130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:46:54.251501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-46e99f0f-1ff8-4a33-b696-642d7d39130c None None] MFA Rules not processed for user `f5a10f7c3b0a41ca8bd08cb83f850c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:46:54.252739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-46e99f0f-1ff8-4a33-b696-642d7d39130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:46:54.338382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1156/2298] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:46:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:09.089659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:09.091265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:09.158706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62c8e6-8f31-42ed-b325-56bf5bd62c42 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:09.164250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:09.165426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:09.165763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:09.166067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] PATH_INFO: `/v3/users/32374a909cc44bb0b22876789037060c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:09.171035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32374a909cc44bb0b22876789037060c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:09.171035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:09.227025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32374a909cc44bb0b22876789037060c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.235695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32374a909cc44bb0b22876789037060c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.249956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32374a909cc44bb0b22876789037060c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.250486 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32374a909cc44bb0b22876789037060c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.251114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32374a909cc44bb0b22876789037060c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.264349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1143/2299] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:47:09 2022] DELETE /identity/v3/users/32374a909cc44bb0b22876789037060c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:47:09.268858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:09.269410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:09.269410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:09.287459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:09.288623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:09.354055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1157/2300] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:09.363658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:09.365198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:09.423466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55758ece-1ac2-4c8d-9845-efff2e8842b6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:09.427056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:09.427747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:09.428036 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:09.428317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:09.438664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:09.439885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1a522-e9ce-4c50-8076-5987bbd99211 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:09.450818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1144/2301] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:47:09.738753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:09.740220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:09.767244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f813403-0ace-4847-b3d1-141e2171fda6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:09.773855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:09.775074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:09.775576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:09.776206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] PATH_INFO: `/v3/projects/4ee19d4a413f415f852c05a51f0c44de` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:09.780322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee19d4a413f415f852c05a51f0c44de)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:09.782320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:09.865147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee19d4a413f415f852c05a51f0c44de', 'request_id': 'req-7aea7efc-ee89-491d-a982-8740c2352186'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.886714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee19d4a413f415f852c05a51f0c44de', 'request_id': 'req-7aea7efc-ee89-491d-a982-8740c2352186'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.893919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee19d4a413f415f852c05a51f0c44de', 'request_id': 'req-7aea7efc-ee89-491d-a982-8740c2352186'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.906011 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] The token cache is being invalidate because project 4ee19d4a413f415f852c05a51f0c44de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:47:09.906679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.908244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7aea7efc-ee89-491d-a982-8740c2352186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:09.913215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1158/2302] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:47:09 2022] DELETE /identity/v3/projects/4ee19d4a413f415f852c05a51f0c44de => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:47:09.915809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:09.916297 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:09.916628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:09.975803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:09.976183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:10.048804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1145/2303] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:10.058551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.058902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.059136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.085022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:10.086464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:10.101831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1159/2304] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:10.102029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.115172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59f64-1739-47c1-9268-dfcd3ff99e12 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.125834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.126787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.127527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.127918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.130223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:47:10.130798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.132872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.149456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1146/2305] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:47:10.154246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.166100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f903-683e-4a62-98d2-a8aadca9d724 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.171881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.172658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.173022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.173564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.174296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.176887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.210739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1160/2306] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:47:10 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:47:10.215303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.226205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea3860-6cbb-4790-9294-bf142879b0a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.325022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.326188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.326718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.327090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.327998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.330576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.357325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1147/2307] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:47:10 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:47:10.361822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.377499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6311-451f-4f5e-baba-3c56289f0d49 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.382668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.383393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.384238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.384519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.385437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.387088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.400248 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1161/2308] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:47:10.404997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.416158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fd49e-98e7-4acf-9731-dd97b422be18 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.421151 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.421833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.422139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.422400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.423142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.424823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cefd9-febc-4de8-ac8c-a1398830124b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.435741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1148/2309] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:47:10.441784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.455815 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84fa2c-334a-4923-9323-966c793b100c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.460690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.461642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.462652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.463008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] PATH_INFO: `/v3/projects/4026e70ea8d34c3a9e14e02b861b4f56/users/6f5cdd39c1274eff8ab6d5a09e2389fc/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.479952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4026e70ea8d34c3a9e14e02b861b4f56, user_id=6f5cdd39c1274eff8ab6d5a09e2389fc, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.482634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.498408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1162/2310] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:47:10 2022] PUT /identity/v3/projects/4026e70ea8d34c3a9e14e02b861b4f56/users/6f5cdd39c1274eff8ab6d5a09e2389fc/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:47:10.509385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.509676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.509960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.539136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] MFA Rules not processed for user `6f5cdd39c1274eff8ab6d5a09e2389fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:10.540510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:10.613759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1149/2311] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:47:10.625596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:10.627586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:10.723685 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416675-dca1-422a-bfae-9f698182381c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:10.729800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:10.730479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:10.730766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:10.731045 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:10.746687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:10.746687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56680349-b038-4ade-812d-3fcff97f97cd service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:10.756877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1163/2312] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:47:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:47:21.145223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:21.207230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c021-63d3-4adb-badf-6f8103c9e8bf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:21.213237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:21.214312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:21.214605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:21.214884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] PATH_INFO: `/v3/users/6f5cdd39c1274eff8ab6d5a09e2389fc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:21.216226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5cdd39c1274eff8ab6d5a09e2389fc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:21.218192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:21.271341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5cdd39c1274eff8ab6d5a09e2389fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.279958 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5cdd39c1274eff8ab6d5a09e2389fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.292918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5cdd39c1274eff8ab6d5a09e2389fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.293787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5cdd39c1274eff8ab6d5a09e2389fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.294399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5cdd39c1274eff8ab6d5a09e2389fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.306666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1150/2313] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:47:21 2022] DELETE /identity/v3/users/6f5cdd39c1274eff8ab6d5a09e2389fc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:47:21.311254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:21.311775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:21.311892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:21.330516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:21.331774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:21.400034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1164/2314] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:21.411529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:21.412928 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:21.485566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7244b1e-2f06-4dde-837b-c343bc1b7457 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:21.489394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:21.490060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:21.490346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:21.490625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:21.502772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:21.503580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b63a2c-8443-4303-b278-565b73847277 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:21.515653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1151/2315] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:47:21.795104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:21.796715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:21.812016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bee6a-34fe-470f-bb68-22d5d382bde8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:21.818180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:21.819063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:21.819350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:21.819668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] PATH_INFO: `/v3/projects/4026e70ea8d34c3a9e14e02b861b4f56` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:21.820907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4026e70ea8d34c3a9e14e02b861b4f56)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:21.823099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:21.880233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4026e70ea8d34c3a9e14e02b861b4f56', 'request_id': 'req-8fcb3005-9956-41a3-a0f2-b5f362e14acb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.888267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4026e70ea8d34c3a9e14e02b861b4f56', 'request_id': 'req-8fcb3005-9956-41a3-a0f2-b5f362e14acb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.895115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4026e70ea8d34c3a9e14e02b861b4f56', 'request_id': 'req-8fcb3005-9956-41a3-a0f2-b5f362e14acb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.906721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] The token cache is being invalidate because project 4026e70ea8d34c3a9e14e02b861b4f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:47:21.906918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.907733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:21.909515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1165/2316] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:47:21 2022] DELETE /identity/v3/projects/4026e70ea8d34c3a9e14e02b861b4f56 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:47:31.077475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b603-e530-46a3-bbb6-b1277e4f3d1c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:31.078081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b603-e530-46a3-bbb6-b1277e4f3d1c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:31.078081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47b603-e530-46a3-bbb6-b1277e4f3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:31.140723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fb47b603-e530-46a3-bbb6-b1277e4f3d1c None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:31.142214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb47b603-e530-46a3-bbb6-b1277e4f3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:31.231851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1152/2317] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:47:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:31.282202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:31.283819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:31.415941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3005-9956-41a3-a0f2-b5f362e14acb admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:31.421288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:31.422414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:31.422710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:31.422990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:31.457844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:31.457844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:31.464072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1166/2318] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:47:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 17:47:45.801951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada0d9-8776-4bf4-858f-9647bd5c5470 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:45.803322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada0d9-8776-4bf4-858f-9647bd5c5470 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:45.803904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcada0d9-8776-4bf4-858f-9647bd5c5470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:45.826174 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fcada0d9-8776-4bf4-858f-9647bd5c5470 None None] MFA Rules not processed for user `93f2755bf7ac430f9380bf2cf3ecb97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:45.827749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fcada0d9-8776-4bf4-858f-9647bd5c5470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:45.920705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1153/2319] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:47.796671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:47.800957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:47.969527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf26eb2-ed58-4c4c-8a59-afd64c66adff service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:47.980403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:47.981472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:47.981982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:47.982635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:47.985179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:48.000562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:48.002287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:48.021219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1167/2320] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:47:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:47:53.597735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:53.598471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:53.598740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:53.621464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:47:53.622809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:53.630661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1154/2321] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:47:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:47:53.644944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:53.657445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511e3e1-add8-44f1-8726-4e70d0e0faa7 service placement] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:53.662952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:53.664294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:53.664583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:53.664893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:53.673910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:53.675546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:53.685034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1168/2322] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:47:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:47:55.877571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:55.879966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:47:55.951020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040c4f3-e9c2-4422-aa15-c8cfeb7c704a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:55.955590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f441e-7746-446e-821e-65a269953216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:55.956465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f441e-7746-446e-821e-65a269953216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:55.956750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f441e-7746-446e-821e-65a269953216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:55.957053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f441e-7746-446e-821e-65a269953216 admin admin] PATH_INFO: `/v3/users/f5a10f7c3b0a41ca8bd08cb83f850c38` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:55.958267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f441e-7746-446e-821e-65a269953216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a10f7c3b0a41ca8bd08cb83f850c38)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:55.960288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f441e-7746-446e-821e-65a269953216 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:56.019285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a10f7c3b0a41ca8bd08cb83f850c38'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.026932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a10f7c3b0a41ca8bd08cb83f850c38'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.040058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a10f7c3b0a41ca8bd08cb83f850c38'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.040753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a10f7c3b0a41ca8bd08cb83f850c38'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.041360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a10f7c3b0a41ca8bd08cb83f850c38'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.056793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1155/2323] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:47:55 2022] DELETE /identity/v3/users/f5a10f7c3b0a41ca8bd08cb83f850c38 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:47:56.270160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:47:56.283078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc636e94-9233-43a9-adc6-6c662f023012 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:47:56.369598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:47:56.370506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:47:56.370793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:47:56.371072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] PATH_INFO: `/v3/projects/563af4481d544b74bc5afba3f426e7e5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:47:56.372533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563af4481d544b74bc5afba3f426e7e5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:47:56.374510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:47:56.434152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563af4481d544b74bc5afba3f426e7e5', 'request_id': 'req-ee530e78-97e4-418e-a132-4a9e8402f543'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.448060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563af4481d544b74bc5afba3f426e7e5', 'request_id': 'req-ee530e78-97e4-418e-a132-4a9e8402f543'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.459783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563af4481d544b74bc5afba3f426e7e5', 'request_id': 'req-ee530e78-97e4-418e-a132-4a9e8402f543'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.473107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] The token cache is being invalidate because project 563af4481d544b74bc5afba3f426e7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:47:56.473415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.474161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ee530e78-97e4-418e-a132-4a9e8402f543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:47:56.475859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1169/2324] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:47:56 2022] DELETE /identity/v3/projects/563af4481d544b74bc5afba3f426e7e5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:48:01.689825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:01.691318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:01.705631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f441e-7746-446e-821e-65a269953216 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:01.765997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:01.766904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:01.767198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:01.767522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] PATH_INFO: `/v3/users/f59e298554b04f5fb08080453b7d7f26` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:01.768823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59e298554b04f5fb08080453b7d7f26)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:01.770889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:01.825270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59e298554b04f5fb08080453b7d7f26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:01.833442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59e298554b04f5fb08080453b7d7f26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:01.846143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59e298554b04f5fb08080453b7d7f26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:01.846895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59e298554b04f5fb08080453b7d7f26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:01.847562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59e298554b04f5fb08080453b7d7f26'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:01.861054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1156/2325] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:48:01 2022] DELETE /identity/v3/users/f59e298554b04f5fb08080453b7d7f26 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:48:01.870288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:01.870820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:01.870820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:01.890296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:01.891779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:01.960450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1170/2326] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:01.970622 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:01.972067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:02.031080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef7185-aa90-4ff9-a26b-5fe338cca253 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.035503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.036165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.036451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.036723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.047594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.049059 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f7974-29b7-4c9c-aef4-40b3cad316e5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.060505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1157/2327] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:48:02.408596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.411201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:02.430928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ecbf6-434c-4972-8cf4-97f453cd87f1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.438728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.440278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.440780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.441279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] PATH_INFO: `/v3/projects/6126496c6e17480cafcf3de24249611a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.443556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6126496c6e17480cafcf3de24249611a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.449015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.505950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6126496c6e17480cafcf3de24249611a', 'request_id': 'req-98ebc400-1356-43b4-b715-4bf1eee9aadc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:02.515029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6126496c6e17480cafcf3de24249611a', 'request_id': 'req-98ebc400-1356-43b4-b715-4bf1eee9aadc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:02.521520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6126496c6e17480cafcf3de24249611a', 'request_id': 'req-98ebc400-1356-43b4-b715-4bf1eee9aadc'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:02.536311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] The token cache is being invalidate because project 6126496c6e17480cafcf3de24249611a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:48:02.536591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:02.537315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-98ebc400-1356-43b4-b715-4bf1eee9aadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:48:02.538913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1171/2328] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:48:02 2022] DELETE /identity/v3/projects/6126496c6e17480cafcf3de24249611a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:48:02.544643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.544986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.545219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.563529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:02.564783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:02.626046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1158/2329] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:02.635540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.635830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.636430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.657740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:02.658997 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:02.667327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1172/2330] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:02.672032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.682736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b566b-bd26-411c-a3e8-ec6556d30d0d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.687656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.688355 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.688646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.688927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.689704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:48:02.690016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.691786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.706733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1159/2331] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:48:02.712555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.723577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d4e7a-e04b-4ae7-acb1-9a7dfb6c8b75 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.729301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.729996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.730295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.730581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.731316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.733307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.772377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1173/2332] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:48:02 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:48:02.776549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.786978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db83dc-5344-4a41-b44f-7f9c7f754016 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.853860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.854543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.854827 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.855129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.855905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.858010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.881690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1160/2333] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:48:02 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:48:02.887908 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.902964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5160-a7d4-4992-8862-b165861ce08d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.908633 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.909337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.909625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.909898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.910662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.912371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.925058 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1174/2334] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:48:02.929758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.941023 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60d64-d3d7-4b16-8653-637c0dc5c79b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:02.946882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:02.947607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:02.948154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:02.948154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:02.948900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:02.950558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8c69a-a659-465c-bf84-69986a80a26d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:02.970241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1161/2335] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:48:02.975774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:02.997260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6303f-d254-411b-a01c-050e8e9fd898 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:03.008658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:03.010279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:03.010594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:03.010878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] PATH_INFO: `/v3/projects/f582fd9ef9094e8f9b47f7e686e3808a/users/1b437da424eb4eb2b36382912fc3e366/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:03.032053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f582fd9ef9094e8f9b47f7e686e3808a, user_id=1b437da424eb4eb2b36382912fc3e366, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:03.035415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:03.053363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1175/2336] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:48:02 2022] PUT /identity/v3/projects/f582fd9ef9094e8f9b47f7e686e3808a/users/1b437da424eb4eb2b36382912fc3e366/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:48:03.058897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf46db-86c4-49e1-a550-744f700f6487 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:03.059203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf46db-86c4-49e1-a550-744f700f6487 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:03.059508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf46db-86c4-49e1-a550-744f700f6487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:03.080119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dddf46db-86c4-49e1-a550-744f700f6487 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:03.081845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dddf46db-86c4-49e1-a550-744f700f6487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:03.158870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1162/2337] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:03.160833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:03.162906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:03.229335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207419-de81-4c2e-8d3d-6ab15b6da2f9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:03.232998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:03.233671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:03.233960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:03.234240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:03.244911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:03.246402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:03.257239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1176/2338] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:48:08.125279 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.125751 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.125868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.157483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] MFA Rules not processed for user `1b437da424eb4eb2b36382912fc3e366`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:08.158962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:08.247327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1163/2339] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:08.251802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.264287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8962-1163-4a0f-b63a-20c0c08b4110 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.272589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.273330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.273631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.273906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.274732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.276736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.309140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1177/2340] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:48:08 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:48:08.314931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.329261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d5e1-a432-4107-be36-7bfc79e26aa0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.404806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.405433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.405722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.406032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.406705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.408697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.433285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1164/2341] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:48:08 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:48:08.438172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.450009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368af3a-8dab-400b-9e02-ac1f6a920f4a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.454959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.455691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.455976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.456260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.457007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.459504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.471897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1178/2342] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:48:08.475973 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.487757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06553bae-a1c8-4591-96e8-9c06e147e4b6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.494004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.494912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.495195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.495507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] PATH_INFO: `/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e/users/6c095989d3384aa8b97947dd0f194596/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.512471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d9d151f6884432b1f5abf6e4507e2e, user_id=6c095989d3384aa8b97947dd0f194596, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.515326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.531095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1165/2343] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:48:08 2022] PUT /identity/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e/users/6c095989d3384aa8b97947dd0f194596/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:48:08.535131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.545566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce9e5-e93c-4248-8011-b735aa7704f4 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.607929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.608556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.608840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.609108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.609844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.611470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8ee3-6b58-48c4-a3c5-775d527e8cc0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.623748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1179/2344] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:48:08.627852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:08.639011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e78f8-0a33-4d7a-a1db-ce9810110bc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:08.643974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:08.644871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:08.645156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:08.645435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] PATH_INFO: `/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e/users/6c095989d3384aa8b97947dd0f194596/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:08.647499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0d9d151f6884432b1f5abf6e4507e2e, user_id=6c095989d3384aa8b97947dd0f194596, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:08.650577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:08.662754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1166/2345] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:48:08 2022] PUT /identity/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e/users/6c095989d3384aa8b97947dd0f194596/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:48:13.767583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518aa7-054f-4455-8703-6f2a7c76db92 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:13.768043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518aa7-054f-4455-8703-6f2a7c76db92 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:13.768169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518aa7-054f-4455-8703-6f2a7c76db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:13.797951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-35518aa7-054f-4455-8703-6f2a7c76db92 None None] MFA Rules not processed for user `6c095989d3384aa8b97947dd0f194596`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:13.799191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-35518aa7-054f-4455-8703-6f2a7c76db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:13.880085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1180/2346] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:13.894172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:13.895934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:13.996983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee3cdc-0945-4e2b-ae78-1d6e0f8fd5e2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:14.001204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:14.001907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:14.002199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:14.002483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:14.065779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:14.067266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:14.078219 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1167/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:48:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:48:14.187493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1100-34bc-44ea-a3cc-8b5f34dc9c80 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:14.187796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1100-34bc-44ea-a3cc-8b5f34dc9c80 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:14.188084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1100-34bc-44ea-a3cc-8b5f34dc9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:14.207849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b91b1100-34bc-44ea-a3cc-8b5f34dc9c80 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:14.208994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b91b1100-34bc-44ea-a3cc-8b5f34dc9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:14.276715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1181/2348] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:14.289361 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:14.290809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:14.362038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376cdd7-b2a8-4332-859c-943348645d21 service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:14.368179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:14.369049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:14.369370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:14.369652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:14.378573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:14.380278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5af6b-509a-4a09-87ea-1f07f6a2e088 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:14.389349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1168/2349] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:48:23.246772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:23.247583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:23.247583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:23.266110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] MFA Rules not processed for user `1b437da424eb4eb2b36382912fc3e366`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:23.267339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:23.274897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1182/2350] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:48:25.192674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b4e4-8588-473a-9a6e-ba08267e26f2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:25.193339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b4e4-8588-473a-9a6e-ba08267e26f2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:25.193704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b4e4-8588-473a-9a6e-ba08267e26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:25.215966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7d18b4e4-8588-473a-9a6e-ba08267e26f2 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:25.217754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7d18b4e4-8588-473a-9a6e-ba08267e26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:25.226457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1169/2351] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:48:25.239942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:48:25.262746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c7852-0066-48fe-a03a-8ac7efa745af None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:48:25.269643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:48:25.270841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:25.271242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:25.271663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:25.281522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:48:25.283142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad36a4-51c5-421a-877e-78b1fadcd2a7 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:48:25.293500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1183/2352] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:48:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:48:59.551060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:48:59.551663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:48:59.551663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:48:59.574957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] MFA Rules not processed for user `e6a99e5d684a48a2845d3379e7df812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:48:59.576217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:48:59.634724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1170/2353] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:48:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:02.206361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01284-7438-447d-af2b-1179a32b60d7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:02.206972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01284-7438-447d-af2b-1179a32b60d7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:02.206972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c01284-7438-447d-af2b-1179a32b60d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:02.227862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-91c01284-7438-447d-af2b-1179a32b60d7 None None] MFA Rules not processed for user `37203169f06d42c59dc670dc416caf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:02.230724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-91c01284-7438-447d-af2b-1179a32b60d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:02.298510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1184/2354] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:49:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:13.340245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:13.341664 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:13.399244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6ba29-82bb-4cf6-898f-e2f3f84e61d6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:13.402831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:13.403527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:13.403819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:13.404099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:13.413708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:13.415845 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:13.426115 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1171/2355] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:16.895637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:16.896578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:16.896864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:16.917875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:16.919096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:16.927002 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1185/2356] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:49:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:16.950373 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:16.962727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6ca14-3ea4-4b93-b8ff-eb8af0b1f995 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:16.968530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:16.969172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:16.969460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:16.969741 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:16.979393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:16.981730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:16.999422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1172/2357] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:49:32.536937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:32.546866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deba424-9760-4f9b-ae14-61b9d1392b4c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:32.550592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:32.551245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:32.551581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:32.551862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:32.553655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:32.641013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:32.642465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:32.663575 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1186/2358] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:35.096699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:35.106086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03247d-9e83-4248-a570-d0df3a411c3e service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:35.111119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:35.111835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:35.112123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:35.112434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:35.115339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:35.133256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:35.134834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255e91-2503-4e11-af02-c5ba6ed5a28b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:35.147688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1173/2359] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:35.767692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:35.778483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb1178-fb5e-4fba-b86c-72a04db00c8e service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:35.791018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:35.791643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:35.791935 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:35.792692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:35.794365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:35.805605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:35.807204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a6290-f7e6-458b-9cea-61fcb331e72d service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:35.816128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1187/2360] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:35.934409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:35.934811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:35.935176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:35.936659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1174/2361] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 17:49:35.943919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7228d-b0af-473a-8983-10108e953527 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:35.944346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7228d-b0af-473a-8983-10108e953527 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:35.951823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7228d-b0af-473a-8983-10108e953527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:35.995061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b7e7228d-b0af-473a-8983-10108e953527 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:35.999895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b7e7228d-b0af-473a-8983-10108e953527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.008379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1188/2362] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:49:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:36.020707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:36.025588 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.045951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39e292-fd73-4004-bd66-987f45a0d15b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:36.049866 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:36.050667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.051024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.051397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.064507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:36.065980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bf83e-da23-4261-8f86-fd546d4eeecb service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:36.079407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1175/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:36.153438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81aa1a-9e8a-4c57-a9fd-707f6a0c6adf None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.153738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81aa1a-9e8a-4c57-a9fd-707f6a0c6adf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.154018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81aa1a-9e8a-4c57-a9fd-707f6a0c6adf None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.155655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1189/2364] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:49:36.162017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278bcca-1cb7-45e2-88e3-afa6145b5f20 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.162017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278bcca-1cb7-45e2-88e3-afa6145b5f20 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.162017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278bcca-1cb7-45e2-88e3-afa6145b5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.181683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8278bcca-1cb7-45e2-88e3-afa6145b5f20 None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:36.182913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8278bcca-1cb7-45e2-88e3-afa6145b5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.189612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1176/2365] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:49:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:36.202351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81aa1a-9e8a-4c57-a9fd-707f6a0c6adf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:36.213366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81aa1a-9e8a-4c57-a9fd-707f6a0c6adf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:36.217021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:36.217663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.217952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.218224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.225365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:36.226827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70217778-527a-4b93-a758-0f1e6efbbb93 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:36.234504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1190/2366] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:36.326364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465beba9-ecf6-4dec-99bc-8ab21e0f00dd None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.326763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465beba9-ecf6-4dec-99bc-8ab21e0f00dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.327054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465beba9-ecf6-4dec-99bc-8ab21e0f00dd None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.328496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1177/2367] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:49:36.334582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.335087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.335888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.356189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:36.357425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.367768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1191/2368] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:49:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:36.378443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465beba9-ecf6-4dec-99bc-8ab21e0f00dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:36.390131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465beba9-ecf6-4dec-99bc-8ab21e0f00dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:36.394309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:36.394955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.395236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.395559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.406578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:36.408042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:36.420202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1178/2369] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:36.486987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:36.488447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.556208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0efde4-c23a-4447-981b-f1674a2fbb84 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:36.561457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:36.562119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:36.562412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:36.562696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:36.564561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:36.577189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:36.578569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af592d96-dbd1-4ddd-86d3-68256b5d7b37 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:36.588882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1192/2370] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:45.407740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:45.409400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:45.424066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db3c76-3227-45cb-b3c6-26b6eafab430 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:45.429782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:45.430416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:45.430699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:45.430977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:45.432729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:45.504069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:45.505723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:45.515702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1179/2371] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:49:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:49:46.999833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:47.000336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:47.000432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:47.018944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:49:47.020224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:49:47.028370 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1193/2372] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:49:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:49:47.041754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:49:47.053157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c72fc-5df9-4619-a8a7-ad118f4fd847 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:49:47.058196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:49:47.058858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:49:47.059152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:49:47.059464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:49:47.068043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:49:47.070409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:49:47.079907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1180/2373] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:50:09.348120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:09.361743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58168b9-d9be-4afc-a101-1ffb67a7eb43 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:09.368182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:09.368849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:09.369137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:09.369587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:09.371631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:09.386301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:09.388279 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:09.400951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1194/2374] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:50:16.959410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:16.972349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7a88-eb47-41db-ab2f-d6c7ab05ebc0 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:16.978424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:16.979065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:16.979356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:16.979672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:16.981447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:17.039461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:17.041080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:17.049986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1181/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:50:20.096527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:20.097986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:20.123100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c5a7c-366f-4812-8f9d-19599568d73c service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:20.131110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:20.131904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:20.132288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:20.132654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:20.137022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:20.153872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:20.155568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeb3f2-a42d-46e0-9982-26d4c052b6d4 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:20.169229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1195/2376] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:50:20.807386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:20.816779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67874d7f-ae15-44fd-8618-00d241cbbf25 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:20.820352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:20.821027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:20.821310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:20.821585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:20.823685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:20.833510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:20.834994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:20.843527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1182/2377] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:50:23.647540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:23.648283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:23.648283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:23.670232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:23.671509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:23.681335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1196/2378] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:50:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:23.713987 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:23.729616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819253ca-dd62-4c93-ac00-27896596fc43 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:23.736397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:23.737169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:23.737519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:23.737997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:23.749251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:23.750804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:23.760899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1183/2379] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:50:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:50:41.144743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.146146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:41.214232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb25a2f-98bd-4e1e-b83c-220fcd918197 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:41.224385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:41.225288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.225577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.225861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] PATH_INFO: `/v3/users/37203169f06d42c59dc670dc416caf38` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.227717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37203169f06d42c59dc670dc416caf38)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:41.229665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:41.275523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37203169f06d42c59dc670dc416caf38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.276196 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37203169f06d42c59dc670dc416caf38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.290184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37203169f06d42c59dc670dc416caf38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.290828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37203169f06d42c59dc670dc416caf38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.298337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-551567cd-da67-43e7-8b79-94550ad56314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37203169f06d42c59dc670dc416caf38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.313857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1197/2380] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:50:41 2022] DELETE /identity/v3/users/37203169f06d42c59dc670dc416caf38 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:50:41.496225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.511035 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e33f4-9b12-47cf-a61a-3d51adff4724 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:41.580914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:41.581736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.582467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.582467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] PATH_INFO: `/v3/projects/9a2c0807e3fc4161b894f123e8acc473` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.583773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2c0807e3fc4161b894f123e8acc473)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:41.585860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:41.637771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2c0807e3fc4161b894f123e8acc473', 'request_id': 'req-b609bf82-aa1b-4193-8b65-e1193c31e486'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.644125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2c0807e3fc4161b894f123e8acc473', 'request_id': 'req-b609bf82-aa1b-4193-8b65-e1193c31e486'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.652726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2c0807e3fc4161b894f123e8acc473', 'request_id': 'req-b609bf82-aa1b-4193-8b65-e1193c31e486'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.664539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] The token cache is being invalidate because project 9a2c0807e3fc4161b894f123e8acc473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:50:41.664831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.665518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b609bf82-aa1b-4193-8b65-e1193c31e486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:50:41.667102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1184/2381] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:50:41 2022] DELETE /identity/v3/projects/9a2c0807e3fc4161b894f123e8acc473 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:50:41.672414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.672894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.673312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.693037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:41.694252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:41.762447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1198/2382] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:41.770123 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.770473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.770747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.790319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:41.791595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:41.799790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1185/2383] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:41.803983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.814531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c413-5adf-4498-8a2c-5c7d8141422f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:41.821238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:41.821942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.822457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.822801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.823496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:50:41.823826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:41.825429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:41.839311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1199/2384] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:50:41.842940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.853049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6be70-e534-4b15-9667-a27c3e5df4b1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:41.858537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:41.859540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.859832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.860111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.860934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:41.863222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:41.891348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1186/2385] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:50:41 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:50:41.893190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.903858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59278bc-d76e-4852-8d30-aa89df3e773b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:41.959423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:41.960101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:41.960915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:41.961258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:41.961951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:41.963900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:41.983738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1200/2386] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:50:41 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:50:41.987726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:41.997785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32713288-eba6-40b2-a5ab-88c226b35631 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:42.002719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:42.003441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:42.003733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:42.004013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:42.004790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:42.006366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:42.017107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1187/2387] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:50:42.021188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:42.031915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154c71b-9e61-4bc7-80b1-80ee2b8b8e6d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:42.036634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:42.037294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:42.037583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:42.037864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:42.038643 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:42.040772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6fc6f-62de-41eb-8b00-535cf1c351b9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:42.050492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1201/2388] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:50:42.054676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:42.064860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33be30d-1a85-4d53-9e7b-7b98043af926 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:42.069596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:42.070501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:42.070785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:42.071147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] PATH_INFO: `/v3/projects/c93f0e69798e491aba3c8cf1493c2733/users/798edb753845410fa6f9c136b43abf05/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:42.086270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93f0e69798e491aba3c8cf1493c2733, user_id=798edb753845410fa6f9c136b43abf05, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:42.089152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:42.102590 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1188/2389] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:50:42 2022] PUT /identity/v3/projects/c93f0e69798e491aba3c8cf1493c2733/users/798edb753845410fa6f9c136b43abf05/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:50:42.107812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e73fa-2581-4ea8-ad33-85c8e0c4daca None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:42.108198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e73fa-2581-4ea8-ad33-85c8e0c4daca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:42.108563 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e73fa-2581-4ea8-ad33-85c8e0c4daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:42.126597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-e36e73fa-2581-4ea8-ad33-85c8e0c4daca None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:42.127832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e36e73fa-2581-4ea8-ad33-85c8e0c4daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:42.186405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1202/2390] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:42.197022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:42.199001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:42.254766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfc5e8-38a8-4b7a-af84-d469797ef7f4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:42.258496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:42.259145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:42.259471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:42.259755 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:42.269062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:42.270500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:42.279994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1189/2391] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:50:46.604278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:46.604779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:46.604969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:46.639123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] MFA Rules not processed for user `798edb753845410fa6f9c136b43abf05`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:46.640417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:46.729294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1203/2392] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:46.730624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:46.743172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a399751-0434-424a-9d23-51e4bf2f7348 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:46.749703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:46.750490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:46.750781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:46.751132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:46.752442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:46.755254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:46.806478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1190/2393] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:50:46 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:50:46.807816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:46.825546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32538efe-d9b5-4fc4-ba36-b8811689a467 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:46.895506 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:46.896296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:46.896583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:46.896861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:46.897569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:46.900434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:46.925255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1204/2394] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:50:46 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:50:46.930179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:46.941577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78759d6-f6dc-46e5-b3e7-1d96ee395736 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:46.948085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:46.948768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:46.949051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:46.949328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:46.950061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:46.951734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:46.963050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1191/2395] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:50:46.967407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:46.990670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf72ab-5047-45d1-bbdf-79b0037cb23d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:46.997737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:46.998653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:46.998948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:46.999239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] PATH_INFO: `/v3/projects/ddd02c052d5f458e8f2cb70d605f2101/users/2ae9850c094842ae8a899d08a48b3b91/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:47.016546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd02c052d5f458e8f2cb70d605f2101, user_id=2ae9850c094842ae8a899d08a48b3b91, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:47.021034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:47.053138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1205/2396] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:50:46 2022] PUT /identity/v3/projects/ddd02c052d5f458e8f2cb70d605f2101/users/2ae9850c094842ae8a899d08a48b3b91/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:50:47.057426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:47.067875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d032114-0bbe-4a21-92dd-b71b1acd76e5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:47.131197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:47.132344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:47.132823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:47.133248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:47.134172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:47.135862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6715-238f-42e3-9266-c9a4c8467981 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:47.146241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1192/2397] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:50:47.150842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:47.161944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5daf8-2a22-4f29-8b34-f963d42936f3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:47.167686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:47.168578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:47.169038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:47.169318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] PATH_INFO: `/v3/projects/ddd02c052d5f458e8f2cb70d605f2101/users/2ae9850c094842ae8a899d08a48b3b91/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:47.171847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd02c052d5f458e8f2cb70d605f2101, user_id=2ae9850c094842ae8a899d08a48b3b91, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:47.174743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493b955-cf45-4ba7-a39e-8fe9c72666e8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:47.186861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1206/2398] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:50:47 2022] PUT /identity/v3/projects/ddd02c052d5f458e8f2cb70d605f2101/users/2ae9850c094842ae8a899d08a48b3b91/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:50:52.584942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:52.586519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:52.587398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:52.615849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] MFA Rules not processed for user `93f2755bf7ac430f9380bf2cf3ecb97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:52.617528 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:52.711661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1193/2399] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:52.781513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c386-00f9-4aa3-8713-41ed240a7390 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:52.781945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c386-00f9-4aa3-8713-41ed240a7390 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:52.782073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627c386-00f9-4aa3-8713-41ed240a7390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:52.846094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0627c386-00f9-4aa3-8713-41ed240a7390 None None] MFA Rules not processed for user `2ae9850c094842ae8a899d08a48b3b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:50:52.847431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0627c386-00f9-4aa3-8713-41ed240a7390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:52.965669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1207/2400] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:50:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:50:52.982456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:50:52.983940 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:50:53.102175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271bd7-8d22-4dad-b259-f005be185cb3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:50:53.109446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:50:53.110218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:50:53.110583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:50:53.110934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:50:53.192481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:50:53.194510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:50:53.213190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1194/2401] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:50:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:51:19.159322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:19.159981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:19.160286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:19.187889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] MFA Rules not processed for user `798edb753845410fa6f9c136b43abf05`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:51:19.189115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:19.198336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1208/2402] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:51:26.252290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:51:26.253722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:26.269991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cab874-decb-4ea1-a857-630a69964fbf service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:51:26.276382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:51:26.277053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:26.277338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:26.277615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:26.280568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:26.345205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:51:26.346872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee96d1-71be-44f3-9d34-8ac9f18bd7ce service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:51:26.357571 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1195/2403] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:51:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:51:40.094610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:51:40.152243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49f437-3534-4ebf-bb0f-aec8fa3207cf None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:51:40.156040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:51:40.156709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:40.156999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:40.157277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:40.168147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:51:40.169763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:51:40.180098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1209/2404] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:51:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:51:42.094061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389644-eac0-4785-9cc8-b9d8794045c7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:42.094669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389644-eac0-4785-9cc8-b9d8794045c7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:42.094669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389644-eac0-4785-9cc8-b9d8794045c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:42.114862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-00389644-eac0-4785-9cc8-b9d8794045c7 None None] MFA Rules not processed for user `e6a99e5d684a48a2845d3379e7df812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:51:42.116177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-00389644-eac0-4785-9cc8-b9d8794045c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:42.123868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1196/2405] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:51:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:51:42.637991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:51:42.646689 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfedd7f-22fa-4a88-a256-4d63352bd194 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:51:42.651103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:51:42.652079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:42.652516 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:42.653075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:42.655889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:42.669097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:51:42.670821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:51:42.682411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1210/2406] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:51:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:51:56.190450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc843e9-7205-4529-8f55-835b839072da None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:56.190983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc843e9-7205-4529-8f55-835b839072da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:56.191105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc843e9-7205-4529-8f55-835b839072da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:56.209834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5fc843e9-7205-4529-8f55-835b839072da None None] MFA Rules not processed for user `ed37128b78a6454c9c387ad91995a05d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:51:56.211838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5fc843e9-7205-4529-8f55-835b839072da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:56.268146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1197/2407] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:51:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:51:59.604855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:51:59.623716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05661a-f7cd-4a83-b460-b9bd32a81950 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:51:59.633311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:51:59.634649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:51:59.635164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:51:59.635717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:51:59.638793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:51:59.662299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:51:59.665768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:51:59.691837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1211/2408] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:51:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:52:26.060913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc843e9-7205-4529-8f55-835b839072da None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:26.064726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5fc843e9-7205-4529-8f55-835b839072da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:26.077684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc843e9-7205-4529-8f55-835b839072da None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:26.081359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:26.082030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:26.082298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:26.082576 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:26.084478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:26.147767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:26.149734 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:26.159892 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1198/2409] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:52:29.542970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:29.552832 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:29.570122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad94a84-724c-4499-93c4-c73df5db00a3 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:29.575705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:29.576677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:29.577202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:29.577552 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] PATH_INFO: `/v3/users/93f2755bf7ac430f9380bf2cf3ecb97f` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:29.578966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f2755bf7ac430f9380bf2cf3ecb97f)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:29.581547 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:29.640016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f2755bf7ac430f9380bf2cf3ecb97f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:29.640722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f2755bf7ac430f9380bf2cf3ecb97f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:29.653847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f2755bf7ac430f9380bf2cf3ecb97f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:29.654605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f2755bf7ac430f9380bf2cf3ecb97f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:29.662155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-48a82603-536c-4545-ae57-44bc39f04f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f2755bf7ac430f9380bf2cf3ecb97f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:29.676688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1212/2410] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:52:29 2022] DELETE /identity/v3/users/93f2755bf7ac430f9380bf2cf3ecb97f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:52:29.867343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:29.878619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27c9a7-dcf9-4c82-8731-b6a5bf0ab29c service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:29.942509 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:29.943424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:29.943717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:29.944003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] PATH_INFO: `/v3/projects/ec9da2f35bcd444fa485c453103df5cc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:29.945309 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9da2f35bcd444fa485c453103df5cc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:29.948134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:29.997118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9da2f35bcd444fa485c453103df5cc', 'request_id': 'req-79b9c713-9cc7-4332-91f7-e6e2619e526b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:30.003270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9da2f35bcd444fa485c453103df5cc', 'request_id': 'req-79b9c713-9cc7-4332-91f7-e6e2619e526b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:30.014414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9da2f35bcd444fa485c453103df5cc', 'request_id': 'req-79b9c713-9cc7-4332-91f7-e6e2619e526b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:30.027085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] The token cache is being invalidate because project ec9da2f35bcd444fa485c453103df5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:52:30.027394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:30.028050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-79b9c713-9cc7-4332-91f7-e6e2619e526b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:30.029614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1199/2411] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:52:29 2022] DELETE /identity/v3/projects/ec9da2f35bcd444fa485c453103df5cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:52:30.034576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.034854 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.035136 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.056160 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:30.057471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:30.118825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1213/2412] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:52:30.126469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.126766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.127049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.147253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:30.149113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:30.160371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1200/2413] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:52:30.165393 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.175028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d9f6-8a13-4ee3-99b5-7a56e834f6fd None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.179709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.181453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.181744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.182028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.182768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:52:30.183082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.184783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.197944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1214/2414] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:52:30.202438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.211959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff6398-0565-4659-91be-8f371da5dc9f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.216623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.217276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.217562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.217841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.218546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.220480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.249766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1201/2415] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:52:30 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:52:30.253939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.264492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ed201-2ebb-4e35-9e7a-366fdf6d655c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.322294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.323300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.323677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.324123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.325082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.327530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.348105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1215/2416] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:52:30 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:52:30.352630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.366265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4de39-ac55-49f8-ad92-67c898e01e12 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.371841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.372520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.372811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.373091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.373835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.375475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.387053 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1202/2417] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:52:30.391175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.402144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc078-c041-42da-84cc-c51240a0cdf9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.406891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.408203 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.408490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.408770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.409499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.411084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d212b-0c61-47f0-82ee-b38ac68474b1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.421352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1216/2418] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:52:30.425334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.436149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c190f-8444-46c9-bb03-cdad259e19e8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.440859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.441763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.442051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.442332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] PATH_INFO: `/v3/projects/a83ced38e3ea471399fe49b3162b38e7/users/6a1dcd8a84cf4f33b5405ad0279bf2b4/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.458478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83ced38e3ea471399fe49b3162b38e7, user_id=6a1dcd8a84cf4f33b5405ad0279bf2b4, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.461347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.477937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1203/2419] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:52:30 2022] PUT /identity/v3/projects/a83ced38e3ea471399fe49b3162b38e7/users/6a1dcd8a84cf4f33b5405ad0279bf2b4/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:52:30.483040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2d47-db7e-484e-9876-34d7754e9ed7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.483336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2d47-db7e-484e-9876-34d7754e9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.483649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc2d47-db7e-484e-9876-34d7754e9ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.501771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bfbc2d47-db7e-484e-9876-34d7754e9ed7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:30.502971 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bfbc2d47-db7e-484e-9876-34d7754e9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:30.562310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1217/2420] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:52:30.572164 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:30.574140 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:30.634809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c649b08-245c-4f3f-a31a-4695e1b5e143 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:30.638547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:30.639198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:30.639529 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:30.639805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:30.649158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:30.650621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:30.660423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1204/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:52:35.366773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f76bd-da5f-48a6-b19b-6efdb1a2fdb8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:35.367458 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f76bd-da5f-48a6-b19b-6efdb1a2fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:35.367582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f76bd-da5f-48a6-b19b-6efdb1a2fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:35.405807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-988f76bd-da5f-48a6-b19b-6efdb1a2fdb8 None None] MFA Rules not processed for user `6a1dcd8a84cf4f33b5405ad0279bf2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:35.407235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-988f76bd-da5f-48a6-b19b-6efdb1a2fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:35.478852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1218/2422] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:52:35.494559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:35.496116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:35.580354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dc70e-6bcd-484a-bc85-5cf88a2e9943 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:35.585926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:35.586586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:35.586874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:35.587160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:35.595312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:35.596931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:35.609068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1205/2423] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:52:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:52:37.182835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb69d6-64d7-4822-b6ed-06771f3c158d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:37.183405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb69d6-64d7-4822-b6ed-06771f3c158d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:37.183405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb69d6-64d7-4822-b6ed-06771f3c158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:37.207055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-cfcb69d6-64d7-4822-b6ed-06771f3c158d None None] MFA Rules not processed for user `6a1dcd8a84cf4f33b5405ad0279bf2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:37.208600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-cfcb69d6-64d7-4822-b6ed-06771f3c158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:37.220367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1219/2424] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:52:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:52:49.119768 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:49.122533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:49.207143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574c060-15c8-44c9-9e64-21a1f9838f53 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:49.214128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:49.214818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:49.215104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:49.215409 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:49.217303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:49.233322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:49.235018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:49.247225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1206/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:52:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:52:50.818969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:50.819554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:50.819554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:50.842408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:52:50.843684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:50.907199 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1220/2426] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:52:50.968097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:50.970457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:51.066822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eac9-8932-4e5c-bbbf-998b8a386a8d service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:51.078077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:51.078762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:51.079057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:51.079348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:51.089262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:51.090889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:51.099902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1207/2427] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:52:59.697069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:59.698961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:52:59.713986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640a8c5-c627-4ce2-bcea-771751869252 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:52:59.718770 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:52:59.719738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:52:59.720021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:52:59.720298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] PATH_INFO: `/v3/users/1b437da424eb4eb2b36382912fc3e366` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:52:59.721526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b437da424eb4eb2b36382912fc3e366)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:52:59.723485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:52:59.770587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b437da424eb4eb2b36382912fc3e366'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:59.771263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b437da424eb4eb2b36382912fc3e366'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:59.782914 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b437da424eb4eb2b36382912fc3e366'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:59.783610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b437da424eb4eb2b36382912fc3e366'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:59.792335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b437da424eb4eb2b36382912fc3e366'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:52:59.805347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1221/2428] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:52:59 2022] DELETE /identity/v3/users/1b437da424eb4eb2b36382912fc3e366 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:52:59.982305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:52:59.993907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46f7b-5371-4b2c-a39f-d13ea886f7a2 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:53:00.048611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:53:00.049475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:53:00.049765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:53:00.050047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] PATH_INFO: `/v3/projects/f582fd9ef9094e8f9b47f7e686e3808a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:53:00.051241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f582fd9ef9094e8f9b47f7e686e3808a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:53:00.053178 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:53:00.098985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f582fd9ef9094e8f9b47f7e686e3808a', 'request_id': 'req-a76538e1-5593-4ef0-ba40-272c1be1569d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.105533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f582fd9ef9094e8f9b47f7e686e3808a', 'request_id': 'req-a76538e1-5593-4ef0-ba40-272c1be1569d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.112578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f582fd9ef9094e8f9b47f7e686e3808a', 'request_id': 'req-a76538e1-5593-4ef0-ba40-272c1be1569d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.124557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] The token cache is being invalidate because project f582fd9ef9094e8f9b47f7e686e3808a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:53:00.124846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.125579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.127226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1208/2429] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:52:59 2022] DELETE /identity/v3/projects/f582fd9ef9094e8f9b47f7e686e3808a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:53:00.131237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:53:00.132890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:53:00.146212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d7ce-2659-4738-8a38-bd2e2a82a5f3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:53:00.209690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:53:00.211113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:53:00.211434 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:53:00.211720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] PATH_INFO: `/v3/users/6c095989d3384aa8b97947dd0f194596` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:53:00.212929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c095989d3384aa8b97947dd0f194596)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:53:00.214856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:53:00.260602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c095989d3384aa8b97947dd0f194596'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.261262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c095989d3384aa8b97947dd0f194596'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.272363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c095989d3384aa8b97947dd0f194596'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.273866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c095989d3384aa8b97947dd0f194596'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.280606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b401cf52-0bf6-4350-8366-eb60c4a55208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c095989d3384aa8b97947dd0f194596'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.292944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1222/2430] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:53:00 2022] DELETE /identity/v3/users/6c095989d3384aa8b97947dd0f194596 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:53:00.466701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:53:00.468262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:53:00.482226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76538e1-5593-4ef0-ba40-272c1be1569d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:53:00.548398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:53:00.549271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:53:00.549559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:53:00.549837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] PATH_INFO: `/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:53:00.551064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0d9d151f6884432b1f5abf6e4507e2e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:53:00.553051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:53:00.604082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0d9d151f6884432b1f5abf6e4507e2e', 'request_id': 'req-97333449-f442-423a-bcce-a86fb23c5914'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.610641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0d9d151f6884432b1f5abf6e4507e2e', 'request_id': 'req-97333449-f442-423a-bcce-a86fb23c5914'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.619659 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0d9d151f6884432b1f5abf6e4507e2e', 'request_id': 'req-97333449-f442-423a-bcce-a86fb23c5914'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.631503 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] The token cache is being invalidate because project f0d9d151f6884432b1f5abf6e4507e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:53:00.631794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.633066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97333449-f442-423a-bcce-a86fb23c5914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:53:00.634939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1209/2431] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:53:00 2022] DELETE /identity/v3/projects/f0d9d151f6884432b1f5abf6e4507e2e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:53:47.995553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:53:47.996111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:53:47.996111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:53:48.013640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] MFA Rules not processed for user `e6a99e5d684a48a2845d3379e7df812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:53:48.014960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:53:48.072937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1223/2432] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:53:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:03.793181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bb7-3f10-40a0-af7b-92f24f8b4a6e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:03.793779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bb7-3f10-40a0-af7b-92f24f8b4a6e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:03.794022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691bb7-3f10-40a0-af7b-92f24f8b4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:03.822482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8e691bb7-3f10-40a0-af7b-92f24f8b4a6e None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:03.824155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8e691bb7-3f10-40a0-af7b-92f24f8b4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:03.924665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1210/2433] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:04.000191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:04.002624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:04.117493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e58b-f425-4f1d-a13e-ec0f2b8b3853 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:04.126461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:04.128425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:04.129386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:04.129386 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:04.147357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:04.150363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30390e-b6a6-4965-8acf-6c70de264d82 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:04.167182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1224/2434] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:54:14.898703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3ad8f-89de-4b20-a991-121d7b0af4c2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:14.899652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3ad8f-89de-4b20-a991-121d7b0af4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:14.899652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3ad8f-89de-4b20-a991-121d7b0af4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:14.917925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b0d3ad8f-89de-4b20-a991-121d7b0af4c2 None None] MFA Rules not processed for user `798edb753845410fa6f9c136b43abf05`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:14.919272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0d3ad8f-89de-4b20-a991-121d7b0af4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:14.975058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1211/2435] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:54:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:54:20.786943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:20.787752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:20.787752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:20.789131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1225/2436] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:54:20.795917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd287c2-a435-4882-a4ce-cc0b1c8164fa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:20.796422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd287c2-a435-4882-a4ce-cc0b1c8164fa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:20.796628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd287c2-a435-4882-a4ce-cc0b1c8164fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:20.817168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fbd287c2-a435-4882-a4ce-cc0b1c8164fa None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:20.818259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fbd287c2-a435-4882-a4ce-cc0b1c8164fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:20.896454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1212/2437] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:54:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:20.912366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:20.915451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:20.996497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c5634-a2af-4179-9dbe-331bb7e25583 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:21.002734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:21.003836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.003836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.004085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.016354 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:21.018243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9891e-b1b9-4c89-b3a5-dd0eb68e50c3 service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:21.033063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1226/2438] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:54:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:21.113674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296017-9625-4724-9587-3a9531195fd1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.114039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296017-9625-4724-9587-3a9531195fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.114669 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296017-9625-4724-9587-3a9531195fd1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.116253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1213/2439] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:54:21.122366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e2de-f7d7-41ce-b9ec-a0a50c679a85 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.122800 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e2de-f7d7-41ce-b9ec-a0a50c679a85 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.123180 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980e2de-f7d7-41ce-b9ec-a0a50c679a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.146115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f980e2de-f7d7-41ce-b9ec-a0a50c679a85 None None] MFA Rules not processed for user `66e05683dc88495686fea4cf92a63928`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:21.147491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f980e2de-f7d7-41ce-b9ec-a0a50c679a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:21.210408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1227/2440] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:21.226005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296017-9625-4724-9587-3a9531195fd1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:21.228088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-34296017-9625-4724-9587-3a9531195fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:21.259522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296017-9625-4724-9587-3a9531195fd1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:21.267110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:21.267905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.268335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.268834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.279682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:21.281344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82dbff-4937-4b5c-8294-b4e9e87e00f5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:21.291224 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1214/2441] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:54:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:21.392691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdd89-fe61-4318-a02f-957c9251485f None None] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.393137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdd89-fe61-4318-a02f-957c9251485f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.393526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdd89-fe61-4318-a02f-957c9251485f None None] PATH_INFO: `/` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.396357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1228/2442] 10.222.0.60 () {54 vars in 921 bytes} [Tue May 10 17:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 17:54:21.403196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8802-3aca-4ccd-8084-e0a70b10aef1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.403530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8802-3aca-4ccd-8084-e0a70b10aef1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.403792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8802-3aca-4ccd-8084-e0a70b10aef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.426097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c67f8802-3aca-4ccd-8084-e0a70b10aef1 None None] MFA Rules not processed for user `3a3e49e317144906907311bac205bef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:21.427572 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c67f8802-3aca-4ccd-8084-e0a70b10aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:21.437535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1215/2443] 10.222.0.60 () {58 vars in 1018 bytes} [Tue May 10 17:54:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:21.450290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdd89-fe61-4318-a02f-957c9251485f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:21.467241 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdd89-fe61-4318-a02f-957c9251485f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:21.471884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:21.472933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:21.473409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:21.474295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:21.485976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:21.487471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:21.500283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1229/2444] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:54:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:24.356516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:24.357378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:24.357613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:24.387746 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:24.389812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:24.401156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1216/2445] 10.222.0.60 () {58 vars in 1009 bytes} [Tue May 10 17:54:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:24.414928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:24.426779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bda5d-08f3-44e4-9272-32cb6ba5916b service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:24.433457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:24.434158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:24.434446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:24.434729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:24.444051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:24.445680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:24.455428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1230/2446] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:54:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:54:32.903605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:32.905815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:32.919464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7e2e-5ce0-4b0c-82c3-a2828960447c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:32.923531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:32.924218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:32.924504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:32.924806 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:32.927687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:32.945380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:32.948602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:32.986541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1217/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:54:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:35.563060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:35.573700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44166abe-66ab-4e06-8634-0ee5e08774c9 service swift] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:35.577755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:35.578318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:35.578589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:35.578942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:35.581660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:35.596926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:35.598444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a333aaa-2b82-4713-92b8-b87cf674ef12 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:35.610307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1231/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:54:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:45.611715 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:45.620931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e168d-0e5d-4253-8efd-d8587eb21034 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:45.624911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:45.625566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:45.625849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:45.626131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:45.628055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:45.712155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:45.713603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:45.733970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1218/2449] 10.222.0.60 () {60 vars in 1396 bytes} [Tue May 10 17:54:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:54:46.543620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:46.544137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:46.544261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:46.562064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] MFA Rules not processed for user `855c179ded264256ab7868e39756b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:54:46.563321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:54:46.571174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1232/2450] 10.222.0.60 () {58 vars in 967 bytes} [Tue May 10 17:54:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:54:46.585721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:54:46.597779 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6d084-ae00-48b9-a3af-776ab7b5f01d service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:54:46.603039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e58f759fbae14125a0eb26807c8b98f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:54:46.603925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:54:46.604127 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:54:46.604430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:54:46.612758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:54:46.614383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:54:46.623292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1219/2451] 10.222.0.60 () {60 vars in 1384 bytes} [Tue May 10 17:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 17:55:36.019352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:36.021079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:36.043709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b55edc-5950-45cf-bb7b-de7f9f8e2d58 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:36.050159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:36.050853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:36.051144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:36.051451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:36.053375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:36.071296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:36.072981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:36.097503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1233/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:41.269939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:41.281097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8c0f5-0758-4cc5-b07a-635c8d834466 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:41.285616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:41.286367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:41.286653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:41.286930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:41.288868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:41.300235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:41.301769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:41.311201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1220/2453] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:42.080945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:42.090787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9d5b6-fd61-46c2-bdc9-778648e5c635 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:42.094501 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:42.095141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:42.095463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:42.095739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:42.097534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:42.158483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:42.159955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:42.170068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1234/2454] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:45.400182 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:45.401832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:45.417784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57ab9a-8889-43f7-8981-36cf65c83507 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:45.422431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:45.423306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:45.423628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:45.423913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] PATH_INFO: `/v3/users/e6a99e5d684a48a2845d3379e7df812c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:45.438717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a99e5d684a48a2845d3379e7df812c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:45.440711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:45.489692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a99e5d684a48a2845d3379e7df812c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.497712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a99e5d684a48a2845d3379e7df812c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.510351 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a99e5d684a48a2845d3379e7df812c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.511021 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a99e5d684a48a2845d3379e7df812c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.511679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-de3d5941-4f89-4686-bfe6-983502b1732b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a99e5d684a48a2845d3379e7df812c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.523583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1221/2455] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:55:45 2022] DELETE /identity/v3/users/e6a99e5d684a48a2845d3379e7df812c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:45.691846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:45.703611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594246d8-0b68-478d-9dde-99dc1c81f4dd service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:45.763055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:45.764021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:45.764313 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:45.764595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] PATH_INFO: `/v3/projects/f4e017a4040d450aad862065563ea64d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:45.775443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e017a4040d450aad862065563ea64d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:45.777375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:45.822746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e017a4040d450aad862065563ea64d', 'request_id': 'req-67e1b9f0-cdcc-4319-af9d-e6daa0785791'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.831105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e017a4040d450aad862065563ea64d', 'request_id': 'req-67e1b9f0-cdcc-4319-af9d-e6daa0785791'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.838640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e017a4040d450aad862065563ea64d', 'request_id': 'req-67e1b9f0-cdcc-4319-af9d-e6daa0785791'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.848871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] The token cache is being invalidate because project f4e017a4040d450aad862065563ea64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:55:45.849166 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.849822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-67e1b9f0-cdcc-4319-af9d-e6daa0785791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:45.852040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1235/2456] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:55:45 2022] DELETE /identity/v3/projects/f4e017a4040d450aad862065563ea64d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:45.857026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:45.857311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:45.857593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:45.875626 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:45.876947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:45.936235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1222/2457] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:45.943684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:45.944012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:45.944298 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:45.962525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:45.963760 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:45.971642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1236/2458] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:45.975750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:45.985962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5cf08-0443-4cb4-b551-9fbaf64ff5b2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:45.990710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:45.991394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:45.991697 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:45.992612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:45.993399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:55:45.993706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:45.995312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.006712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1223/2459] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:55:46.010768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.019808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6039a-8c84-4b58-b505-f5fa9fa865ae None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.024531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.025175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.025459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.025731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.026590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.028400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.053746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1237/2460] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:55:46 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:55:46.058544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.068331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aefe21-66b4-47c4-a11e-a1b89de2a8da admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.127858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.128562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.128851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.129132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.129835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.131830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.152269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1224/2461] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:55:46 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:55:46.156356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.166870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8560a-ddf2-41ef-9740-158a6ff68eef admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.171665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.172326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.172613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.172918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.173752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.175486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.186029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1238/2462] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:46.190071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.200735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefacd-ea1a-421e-bd2c-e2e49008d8d1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.205331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.205994 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.206280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.206562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.207289 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.208922 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8063e-89d3-4bfa-b390-2209540ea84b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.218629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1225/2463] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:46.222739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.232688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa753b-3800-4353-95ba-f5c3fb913f63 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.237286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.238165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.238473 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.238748 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] PATH_INFO: `/v3/projects/a750b679b62f424a9e70ed5f47526195/users/0416b0a47eb54ac59dd771c02c1130cb/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.254947 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a750b679b62f424a9e70ed5f47526195, user_id=0416b0a47eb54ac59dd771c02c1130cb, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.257618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.270581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1239/2464] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:55:46 2022] PUT /identity/v3/projects/a750b679b62f424a9e70ed5f47526195/users/0416b0a47eb54ac59dd771c02c1130cb/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:46.281211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.281512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.281813 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.308478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] MFA Rules not processed for user `0416b0a47eb54ac59dd771c02c1130cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:46.309732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:46.381317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1226/2465] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:46.392773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:46.394524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:46.450987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2dfe-1754-4463-996b-e7240fb3ea38 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:46.456236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:46.457252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:46.457546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:46.457877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:46.467308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:46.468772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cef23-2ab8-4005-966c-6c63bd3b0023 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:46.478448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1240/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:54.714954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:54.775632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5e7b4-583d-439e-a96b-717da1e87f93 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:54.780166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:54.781031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:54.781318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:54.781597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] PATH_INFO: `/v3/users/0416b0a47eb54ac59dd771c02c1130cb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:54.782788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0416b0a47eb54ac59dd771c02c1130cb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:54.784757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:54.830063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0416b0a47eb54ac59dd771c02c1130cb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:54.837738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0416b0a47eb54ac59dd771c02c1130cb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:54.849767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0416b0a47eb54ac59dd771c02c1130cb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:54.850614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0416b0a47eb54ac59dd771c02c1130cb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:54.851789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0416b0a47eb54ac59dd771c02c1130cb'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:54.863957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1227/2467] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:55:54 2022] DELETE /identity/v3/users/0416b0a47eb54ac59dd771c02c1130cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:54.869153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:54.869628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:54.869722 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:54.887038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:54.888276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:54.946237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1241/2468] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:55:54.956121 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:54.957527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:55.014579 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e398b-0227-4e72-aa66-a31511e8ea8c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.018347 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.018990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.019280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.019591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.029080 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.030532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe9ac0-3299-4024-888e-1fc4ad13a69f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.040730 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1228/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:55.343646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.345110 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:55.361413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37910b16-2e7a-499c-9e8d-7b4c3c3674b8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.366829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.367879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.368220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.368708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] PATH_INFO: `/v3/projects/a750b679b62f424a9e70ed5f47526195` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.369913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a750b679b62f424a9e70ed5f47526195)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.372125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.435438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a750b679b62f424a9e70ed5f47526195', 'request_id': 'req-bea28429-b5e8-4b01-b357-4ce15d77af91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:55.446152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a750b679b62f424a9e70ed5f47526195', 'request_id': 'req-bea28429-b5e8-4b01-b357-4ce15d77af91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:55.457723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a750b679b62f424a9e70ed5f47526195', 'request_id': 'req-bea28429-b5e8-4b01-b357-4ce15d77af91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:55.469729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] The token cache is being invalidate because project a750b679b62f424a9e70ed5f47526195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:55:55.470034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:55.470763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-bea28429-b5e8-4b01-b357-4ce15d77af91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:55.472817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1242/2470] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:55:55 2022] DELETE /identity/v3/projects/a750b679b62f424a9e70ed5f47526195 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:55.479782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.480154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.480661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.500166 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:55.501737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:55.573454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1229/2471] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:55.582350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.582734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.583212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.605413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:55.606731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:55.615540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1243/2472] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:55:55.620878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.635955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295470a-2275-4bed-a022-20356caf0df5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.640469 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.641165 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.641431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.641711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.642456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:55:55.642808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.644468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.661559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1230/2473] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:55:55.666969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.678559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c33aa-12ca-4128-b32c-df1a342f26ca None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.683470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.684140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.684426 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.684713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.685409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.687422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.721945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1244/2474] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:55:55.726959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.740462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b366-859d-40ac-b65c-423805bd6aa7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.810612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.811310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.812402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.812402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.812749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.814598 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.838589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1231/2475] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:55:55 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:55:55.843665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.856214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128da8-24d9-449e-a8db-e7cdcd4fb11f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.865431 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.866153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.866469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.867435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.868287 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.869911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.883429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1245/2476] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:55.887399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.899524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217606-35c4-45d3-a645-77ad2a9e1456 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.905442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.906054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.906343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.906623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.907395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.909180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c77a0-3799-4754-ad03-55cad7a5e87e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.920639 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1232/2477] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:55.925091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:55.948026 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cbb71-44d1-4018-9b8d-8e56e3968ea9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:55.953460 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:55.954353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:55.954649 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:55.954930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] PATH_INFO: `/v3/projects/cbea2d93b2c741ad983e4085230f9fde/users/99acce603eb64c22bf98b32501090bc3/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:55.978942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbea2d93b2c741ad983e4085230f9fde, user_id=99acce603eb64c22bf98b32501090bc3, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:55.981659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:55.994893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1246/2478] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:55:55 2022] PUT /identity/v3/projects/cbea2d93b2c741ad983e4085230f9fde/users/99acce603eb64c22bf98b32501090bc3/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:56.005184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:56.005478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:56.005804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:56.033155 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] MFA Rules not processed for user `99acce603eb64c22bf98b32501090bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:56.034376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:56.096692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1233/2479] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:56.108512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:56.110174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:56.181919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588e0e5-a7fc-4c4a-b8f2-af97d1cb4cc6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:56.187492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:56.188141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:56.188427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:56.188700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:56.196371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:56.197961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59ab9f-14fc-4233-a1c5-2704ddea3021 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:56.207361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1247/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:56.433441 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:56.495272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24c7c4-d710-493b-b825-b3c8b1949dde None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:56.499902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:56.500780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:56.501063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:56.501344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] PATH_INFO: `/v3/users/99acce603eb64c22bf98b32501090bc3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:56.502543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99acce603eb64c22bf98b32501090bc3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:56.504521 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:56.549678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99acce603eb64c22bf98b32501090bc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:56.557167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99acce603eb64c22bf98b32501090bc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:56.569613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99acce603eb64c22bf98b32501090bc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:56.570396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99acce603eb64c22bf98b32501090bc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:56.571013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99acce603eb64c22bf98b32501090bc3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:56.583030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1234/2481] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:55:56 2022] DELETE /identity/v3/users/99acce603eb64c22bf98b32501090bc3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:56.587960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:56.588424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:56.588713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:56.606202 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:56.607282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:56.665816 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1248/2482] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:56.677962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:56.680295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:56.737061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fc7e-fe75-4885-92f8-fc3349662f43 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:56.740785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:56.741468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:56.742484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:56.742932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:56.752313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:56.753687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020100dd-363c-419f-a084-2ff76bd44714 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:56.763868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1235/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:57.036371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.037790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:57.052728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4822d-1586-49e8-9716-541c990aca39 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.058089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.059625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.059927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.060208 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] PATH_INFO: `/v3/projects/cbea2d93b2c741ad983e4085230f9fde` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.061703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbea2d93b2c741ad983e4085230f9fde)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.063663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.112520 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbea2d93b2c741ad983e4085230f9fde', 'request_id': 'req-3e29ffb5-c288-4279-bafd-5abb43279301'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:57.120479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbea2d93b2c741ad983e4085230f9fde', 'request_id': 'req-3e29ffb5-c288-4279-bafd-5abb43279301'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:57.127043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbea2d93b2c741ad983e4085230f9fde', 'request_id': 'req-3e29ffb5-c288-4279-bafd-5abb43279301'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:57.137859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] The token cache is being invalidate because project cbea2d93b2c741ad983e4085230f9fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:55:57.138149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:57.138824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3e29ffb5-c288-4279-bafd-5abb43279301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:57.140408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1249/2484] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:55:57 2022] DELETE /identity/v3/projects/cbea2d93b2c741ad983e4085230f9fde => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:57.145300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.145597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.145911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.164972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:57.166197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:57.223637 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1236/2485] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:57.232101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.232397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.232679 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.251577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:57.252784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:57.261376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1250/2486] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:57.265549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.276280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878a0dc-5913-46b4-b536-b341897b39ae None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.281211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.281815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.282107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.282384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.283118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:55:57.283464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.285067 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.297321 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1237/2487] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:55:57.301752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.311612 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996f309-f531-438b-8d03-1f92b3e23d29 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.316309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.316957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.317242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.317519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.318222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.320724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.346406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1251/2488] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:55:57.350729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.362301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f494c4-2521-4cbb-9f00-6dfdfdf3bedf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.416977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.417691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.417985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.418266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.419012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.421013 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.441532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1238/2489] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:55:57.445756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.456367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece782c-79ce-41ed-af92-427f2bf5fe52 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.461599 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.462259 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.462549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.462852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.463622 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.465219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.475930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1252/2490] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:57.480999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.490961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7984a-ff7d-46d4-b0a9-f73d114a1c00 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.495955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.496627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.496913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.497190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.497924 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.499543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82047fd4-e778-4a25-a674-e555d06ec6dc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.510723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1239/2491] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:55:57.516314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.527863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f03e-9397-4703-922d-ff14070c16b8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.532651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.533591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.534021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.534310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] PATH_INFO: `/v3/projects/b578ceb7f35242f18df4812d76d213c2/users/b7af04a6d2b844019e1a1f481279070d/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.551337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b578ceb7f35242f18df4812d76d213c2, user_id=b7af04a6d2b844019e1a1f481279070d, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.555785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.570887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1253/2492] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:55:57 2022] PUT /identity/v3/projects/b578ceb7f35242f18df4812d76d213c2/users/b7af04a6d2b844019e1a1f481279070d/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:57.585204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.586229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.586614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.613939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] MFA Rules not processed for user `b7af04a6d2b844019e1a1f481279070d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:57.615311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:57.681685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1240/2493] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:57.686028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.747618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214a1fb-8d76-4dc8-a391-148006997ab3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.752557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.753224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.753515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.753797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.754492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.756452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.787226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1254/2494] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:55:57.789349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.800327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0a771-1099-4137-be40-2584faf4af74 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.858386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.859009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.859393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.859690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.860407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.862340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.885825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1241/2495] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:55:57 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:55:57.886961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.897447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5b97-31a7-43cd-9a52-2f7b576a7d4e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.902439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.903210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.903581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.903952 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.904768 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.906413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.918288 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1255/2496] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:55:57.922524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.933118 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b8fc4-0f37-4ed5-8cf3-f8905675bd29 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:57.938086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:57.938983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:57.939274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:57.939583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] PATH_INFO: `/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64/users/4742a26e384a4f9cbb57b6d414730d85/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:57.956043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f685a4c9ba4ac0b377a8af3d01fd64, user_id=4742a26e384a4f9cbb57b6d414730d85, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:57.958825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:57.972910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1242/2497] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:55:57 2022] PUT /identity/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64/users/4742a26e384a4f9cbb57b6d414730d85/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:55:57.977090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:57.987223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850e44-2938-439b-8684-893d3d0dcec6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:58.043623 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:58.044322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.044485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.044769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.045500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:58.047090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf45114-170c-4c04-823f-e25769296fca admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:58.057666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1256/2498] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:55:58.061904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:58.074009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c604-6d16-41c1-bb86-78d032a495c7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:58.079229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:58.080167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.080456 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.080736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] PATH_INFO: `/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64/users/4742a26e384a4f9cbb57b6d414730d85/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.083003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f685a4c9ba4ac0b377a8af3d01fd64, user_id=4742a26e384a4f9cbb57b6d414730d85, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:58.086512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:58.098195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1243/2499] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:55:58 2022] PUT /identity/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64/users/4742a26e384a4f9cbb57b6d414730d85/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:55:58.108617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.109048 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.109432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.145948 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] MFA Rules not processed for user `4742a26e384a4f9cbb57b6d414730d85`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:58.147557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:58.224168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1257/2500] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:55:58.236203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:58.238479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:58.299010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1c9c-217a-4cc8-b366-a0aa23bad18e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:58.302665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:58.303318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.303651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.303932 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.313320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:58.314767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9f1fc-5998-45b3-ad2d-485a9641c024 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:58.325778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1244/2501] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:58.503877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:58.584777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0baed0-3e66-44ac-bbd7-eb29f2797aba None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:58.590868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:58.591868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.592163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.592495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] PATH_INFO: `/v3/users/b7af04a6d2b844019e1a1f481279070d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.593789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7af04a6d2b844019e1a1f481279070d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:58.595796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:58.652387 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7af04a6d2b844019e1a1f481279070d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:58.653096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7af04a6d2b844019e1a1f481279070d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:58.665696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7af04a6d2b844019e1a1f481279070d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:58.666398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7af04a6d2b844019e1a1f481279070d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:58.674039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7af04a6d2b844019e1a1f481279070d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:58.687701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1258/2502] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:55:58 2022] DELETE /identity/v3/users/b7af04a6d2b844019e1a1f481279070d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:58.692699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.693043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.693400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.711800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:58.712934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:58.773303 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1245/2503] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:55:58.783105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:58.784562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:58.842923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d22eb6-5c79-4de9-96c3-956487e7dcb9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:58.846663 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:58.847321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:58.847644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:58.847930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:58.858079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:58.859554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:58.869868 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1259/2504] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:55:59.157170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:59.158937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:59.172371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f93c1b-8c4e-48a6-a6f3-497c0712d0ac None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:59.177194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:59.178173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:59.178504 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:59.178787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] PATH_INFO: `/v3/projects/b578ceb7f35242f18df4812d76d213c2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:59.180785 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b578ceb7f35242f18df4812d76d213c2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:59.182753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:59.229682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b578ceb7f35242f18df4812d76d213c2', 'request_id': 'req-206de10d-d844-469b-aec4-54832422f13e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.235611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b578ceb7f35242f18df4812d76d213c2', 'request_id': 'req-206de10d-d844-469b-aec4-54832422f13e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.244594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b578ceb7f35242f18df4812d76d213c2', 'request_id': 'req-206de10d-d844-469b-aec4-54832422f13e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.255405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] The token cache is being invalidate because project b578ceb7f35242f18df4812d76d213c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:55:59.255713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.256390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.258773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1246/2505] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:55:59 2022] DELETE /identity/v3/projects/b578ceb7f35242f18df4812d76d213c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:59.262630 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:59.273047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bcfd-5245-462a-83da-09bdce4e4220 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:59.344823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:59.345799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:59.346161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:59.346511 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] PATH_INFO: `/v3/users/4742a26e384a4f9cbb57b6d414730d85` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:59.347945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4742a26e384a4f9cbb57b6d414730d85)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:59.350108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:59.408215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4742a26e384a4f9cbb57b6d414730d85'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.408960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4742a26e384a4f9cbb57b6d414730d85'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.425444 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4742a26e384a4f9cbb57b6d414730d85'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.426436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4742a26e384a4f9cbb57b6d414730d85'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.435856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e3288eb-a1e7-4585-867b-469a3dd2e142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4742a26e384a4f9cbb57b6d414730d85'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.451402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1260/2506] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:55:59 2022] DELETE /identity/v3/users/4742a26e384a4f9cbb57b6d414730d85 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:59.773375 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:55:59.776272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:55:59.797787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de10d-d844-469b-aec4-54832422f13e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:55:59.860273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:55:59.861087 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:59.861377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:59.861666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] PATH_INFO: `/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:59.862906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f685a4c9ba4ac0b377a8af3d01fd64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:55:59.864865 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:55:59.912916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f685a4c9ba4ac0b377a8af3d01fd64', 'request_id': 'req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.924946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f685a4c9ba4ac0b377a8af3d01fd64', 'request_id': 'req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.934222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f685a4c9ba4ac0b377a8af3d01fd64', 'request_id': 'req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.948720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] The token cache is being invalidate because project f2f685a4c9ba4ac0b377a8af3d01fd64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:55:59.949010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.950107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96c729b0-43d0-400a-8e78-84ac6d1f8ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:55:59.952295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1247/2507] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:55:59 2022] DELETE /identity/v3/projects/f2f685a4c9ba4ac0b377a8af3d01fd64 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:55:59.957441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:55:59.957986 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:55:59.959149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:55:59.980201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:55:59.981424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:00.042690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1261/2508] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:00.050544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.050826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.051109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.070954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:00.072405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:00.087350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.091493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1248/2509] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:00.097896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3285b-ff38-4f40-a8ed-c1db2d4bf399 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.102666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.103392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.103755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.104038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.104809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:00.105121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.106732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.119293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1262/2510] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:00.124133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.134341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a7c28-8637-4386-a9f4-46b7a4ac1587 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.139685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.140453 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.140803 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.141137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.141885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.143805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.169825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1249/2511] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:00.173951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.183945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cc49-8b08-4ebe-bea6-79b7dfefc14f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.238810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.239579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.239866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.240147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.240875 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.243031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.262509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1263/2512] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:00.267760 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.277522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2c56-3fd0-40d2-b3ca-7af19513e555 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.282235 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.282902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.283193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.283515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.284252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.285858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.296479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1250/2513] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:00.300436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.310368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10110ef8-683f-4ab9-a4b0-67644a5b7dbe admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.315161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.315867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.316153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.316427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.317150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.318749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a81e0d-eb82-47ee-85de-f74bdf463a66 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.329922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1264/2514] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:00.334136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.345285 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6b1e6-e9c4-4d5a-a492-3a6187925264 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.350201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.351695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.351985 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.352263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] PATH_INFO: `/v3/projects/430379e3acc443778a206d97d80184d9/users/224e374464b94aaa80d8ab19427a2192/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.369824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430379e3acc443778a206d97d80184d9, user_id=224e374464b94aaa80d8ab19427a2192, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.372519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.391496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1251/2515] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:00 2022] PUT /identity/v3/projects/430379e3acc443778a206d97d80184d9/users/224e374464b94aaa80d8ab19427a2192/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:00.403015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.403382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.403680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.431319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] MFA Rules not processed for user `224e374464b94aaa80d8ab19427a2192`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:00.432579 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:00.500740 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1265/2516] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:00.505369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.566516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948072d0-a659-4848-a8fc-87979a45c2c2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.571556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.572218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.572508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.572796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.573487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.575701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.600517 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1252/2517] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:00.605019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.615573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d12c68-61c1-438b-bd94-5cd42d5cb51f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.669959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.670657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.670946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.671282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.672022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.673966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.693609 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1266/2518] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:00.697690 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.708202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d815e8-c2b3-4c46-927a-839e7177ed4e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.713636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.714299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.714589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.714862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.715657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.717262 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.728493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1253/2519] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:00.732610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.742494 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76afa8d-aaa6-4198-b4ec-cc28c5146bc1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.747183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.748086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.748390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.748655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] PATH_INFO: `/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472/users/0a4117a1c7054aba924aac23437ee488/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.762938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590dbbf63f9f42d7bf24d60a84f1f472, user_id=0a4117a1c7054aba924aac23437ee488, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.765753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.778465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1267/2520] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:00 2022] PUT /identity/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472/users/0a4117a1c7054aba924aac23437ee488/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:00.782416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.792799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee73b3b-e3e1-4f91-8cf8-5e211261badb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.847201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.847907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.848507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.848507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.849183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.850780 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0b5ad-4269-40e0-86c8-4d20ba6a7758 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.860728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1254/2521] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:00.865366 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:00.875723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c5ab1-b2eb-4061-ac7f-cd551cba0e76 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:00.881001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:00.881899 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.882688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.882982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] PATH_INFO: `/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472/users/0a4117a1c7054aba924aac23437ee488/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.885075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590dbbf63f9f42d7bf24d60a84f1f472, user_id=0a4117a1c7054aba924aac23437ee488, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:00.887774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:00.898796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1268/2522] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:00 2022] PUT /identity/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472/users/0a4117a1c7054aba924aac23437ee488/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:00.909111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:00.909410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:00.909720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:00.937897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] MFA Rules not processed for user `0a4117a1c7054aba924aac23437ee488`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:00.939047 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:01.006403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1255/2523] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:01.018260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:01.020010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:01.076421 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc2917-a471-48d2-a8b9-dff25ac94aa2 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:01.080097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:01.080747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:01.081034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:01.081311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:01.090872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:01.092350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:01.101644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1269/2524] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:01.173460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:01.185204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529bad6-9998-45ce-af13-61ce9d7f48c3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:01.189086 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:01.189678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:01.189965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:01.190245 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:01.251482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:01.252936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:01.263008 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1256/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:02.454942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:02.456423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:02.516380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2c04-1c26-4042-8a1f-7b519962407d service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:02.519977 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:02.520626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:02.521154 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:02.521438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:02.524170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:02.589041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:02.590601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:02.601403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1270/2526] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:05.876131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:05.877706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:05.902915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70a959-e7d6-4457-9f99-0c609a65d4e0 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:05.907597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:05.908466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:05.908756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:05.909037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] PATH_INFO: `/v3/users/ed37128b78a6454c9c387ad91995a05d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:05.910241 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed37128b78a6454c9c387ad91995a05d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:05.912208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:05.959573 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed37128b78a6454c9c387ad91995a05d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:05.966705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed37128b78a6454c9c387ad91995a05d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:05.978176 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed37128b78a6454c9c387ad91995a05d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:05.978832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed37128b78a6454c9c387ad91995a05d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:05.979478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-152b006b-6cb2-46d3-9106-34a16865214e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed37128b78a6454c9c387ad91995a05d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:05.992320 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1257/2527] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:05 2022] DELETE /identity/v3/users/ed37128b78a6454c9c387ad91995a05d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:06.161871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.179941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c44ace-6999-4604-95d5-8167e1f2b462 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.236012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.236872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.237157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.237435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] PATH_INFO: `/v3/projects/0461acfadf8743fdbd62a39bf3fe3e1c` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.238638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] RBAC: Authorizing `identity:delete_project(project_id=0461acfadf8743fdbd62a39bf3fe3e1c)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.240576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.285640 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0461acfadf8743fdbd62a39bf3fe3e1c', 'request_id': 'req-d034abd8-1f93-4f5f-842f-cdfd6724ecde'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:06.293049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0461acfadf8743fdbd62a39bf3fe3e1c', 'request_id': 'req-d034abd8-1f93-4f5f-842f-cdfd6724ecde'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:06.299081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0461acfadf8743fdbd62a39bf3fe3e1c', 'request_id': 'req-d034abd8-1f93-4f5f-842f-cdfd6724ecde'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:06.309315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] The token cache is being invalidate because project 0461acfadf8743fdbd62a39bf3fe3e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:06.309607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:06.310251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d034abd8-1f93-4f5f-842f-cdfd6724ecde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:06.311811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1271/2528] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:06 2022] DELETE /identity/v3/projects/0461acfadf8743fdbd62a39bf3fe3e1c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:56:06.316747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.317043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.317324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.337934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:06.339189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:06.400233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1258/2529] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:06.408513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.408747 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.409029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.426831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:06.428070 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:06.436732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1272/2530] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:06.440914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.451405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd24f0-68b2-4013-bcd4-f38e7963dc12 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.456264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.456921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.457216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.457507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.458225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:06.458535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.460173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.471462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1259/2531] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:06.475919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.484989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f9d6b-ac81-410b-b800-13363cac48b2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.490051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.490709 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.491007 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.491275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.492567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.494479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.522334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1273/2532] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:06.526841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.537146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013c67f-c1b3-49f8-b03b-3422b32aeda3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.594449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.595128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.595511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.595794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.596501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.598436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.622260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1260/2533] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:06 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:06.623930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.634991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b7c24-9aef-4c16-acda-227fdb1f9b3e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.639811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.640512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.640805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.641090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.641828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.643477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.656043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1274/2534] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:06.660143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.670895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f8cc-9ba4-4508-a326-5a0885c3a1d7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.676051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.676711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.676996 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.677270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.678034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.679861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f67314-0998-491a-a924-cbfaf0a694b7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.689769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1261/2535] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:06.694167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.704650 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f624d-da10-441c-9121-412724bef376 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.709424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.710903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.711326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.711647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] PATH_INFO: `/v3/projects/1c6d7d8385c643b8a61803cd8f01c960/users/47f94493835b463382b4c1f3564adb9e/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.727140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6d7d8385c643b8a61803cd8f01c960, user_id=47f94493835b463382b4c1f3564adb9e, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.730586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.743603 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1275/2536] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:06 2022] PUT /identity/v3/projects/1c6d7d8385c643b8a61803cd8f01c960/users/47f94493835b463382b4c1f3564adb9e/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:06.753980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.754288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.754596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.781306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] MFA Rules not processed for user `47f94493835b463382b4c1f3564adb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:06.782510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:06.845197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1262/2537] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:06.857105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:06.858790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:06.936438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c55d-652a-460d-a854-2017bec0a9b9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:06.945413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459957-193b-4825-8411-5441be3bce4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:06.946085 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459957-193b-4825-8411-5441be3bce4c service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:06.946377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459957-193b-4825-8411-5441be3bce4c service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:06.946659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459957-193b-4825-8411-5441be3bce4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:06.955513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459957-193b-4825-8411-5441be3bce4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:06.957144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459957-193b-4825-8411-5441be3bce4c service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:06.966731 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1276/2538] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:56:10.962312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.023680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652196-22bc-49f4-8021-5a802e2c87dd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.028419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.029299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.029578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.029851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] PATH_INFO: `/v3/users/47f94493835b463382b4c1f3564adb9e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.031048 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f94493835b463382b4c1f3564adb9e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.033180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:11.079758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f94493835b463382b4c1f3564adb9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.089647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f94493835b463382b4c1f3564adb9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.103244 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f94493835b463382b4c1f3564adb9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.104149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f94493835b463382b4c1f3564adb9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.104778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f94493835b463382b4c1f3564adb9e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.119826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1263/2539] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:10 2022] DELETE /identity/v3/users/47f94493835b463382b4c1f3564adb9e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:11.124280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.124804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.124929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.142580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:11.143846 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:11.213424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1277/2540] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:11.223172 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.224500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:11.284794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9d4e-6f1a-4d67-bf42-2520f4d0549b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.289119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.289897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.290184 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.290466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.299684 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.301129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee94e1-879b-4046-b059-d472edfa9d4b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:11.311292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1264/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:11.586639 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.588323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:11.601809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1ef6-d4c1-4a57-8689-4832f353f361 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.606951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.607888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.608179 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.608467 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] PATH_INFO: `/v3/projects/1c6d7d8385c643b8a61803cd8f01c960` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.609695 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6d7d8385c643b8a61803cd8f01c960)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.611667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:11.658422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6d7d8385c643b8a61803cd8f01c960', 'request_id': 'req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.665910 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6d7d8385c643b8a61803cd8f01c960', 'request_id': 'req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.672333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6d7d8385c643b8a61803cd8f01c960', 'request_id': 'req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.682969 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] The token cache is being invalidate because project 1c6d7d8385c643b8a61803cd8f01c960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:11.683268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.683934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-1eb7bfef-a6eb-4260-9cf7-3bcf26b21f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:11.685472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1278/2542] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:11 2022] DELETE /identity/v3/projects/1c6d7d8385c643b8a61803cd8f01c960 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:11.691202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.691700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.692150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.712980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:11.714305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:11.777582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1265/2543] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:11.785675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.786095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.786389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.806883 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:11.808183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:11.819435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1279/2544] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:11.824265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.834674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfe0aa-14af-4529-9dfe-62e0d7d4c80d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.840826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.841516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.841809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.842097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.842852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:11.843169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.844859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:11.857710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1266/2545] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:11.862054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.871587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436795cd-13d6-4895-bebd-c4545fefe831 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.876491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.877152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.877448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.877728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.878425 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.880394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:11.909474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1280/2546] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:11 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:11.912630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:11.924188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f280-e281-4cff-8c1b-029b41f9e5ee admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:11.981661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:11.982348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:11.982634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:11.982920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:11.983688 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:11.985695 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.005891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1267/2547] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:11 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:12.010267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.020456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6725bfa-1bef-4742-b290-493c67ba4dac admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.025751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.026450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.026741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.027022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.027802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.029410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.040406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1281/2548] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:12.044398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.054455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5a50d-4813-4f8a-8de5-60f80d0ac2cb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.059006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.059702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.059991 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.060270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.061000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.062597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a5da5-ed10-4b31-bdbb-70ad68b436b7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.073432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1268/2549] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:12.077998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.089010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f800-8daf-421a-a5b7-aa3d34e5fd73 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.093688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.094564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.094851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.095127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] PATH_INFO: `/v3/projects/74cd9f51027540dea9db6900f2189e0b/users/8e6960eeb6484077ad8ab3d55de62613/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.110055 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cd9f51027540dea9db6900f2189e0b, user_id=8e6960eeb6484077ad8ab3d55de62613, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.112790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.126447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1282/2550] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:12 2022] PUT /identity/v3/projects/74cd9f51027540dea9db6900f2189e0b/users/8e6960eeb6484077ad8ab3d55de62613/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:12.138232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.138532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.138817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.167126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] MFA Rules not processed for user `8e6960eeb6484077ad8ab3d55de62613`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:12.168404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:12.231143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1269/2551] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:12.235591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.307037 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe92c45-7826-4f0a-9bc5-54aec6d56124 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.311996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.312658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.312954 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.313367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.314073 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.316229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.344741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1283/2552] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:12 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:12.348834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.362873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ac642-6fb8-4bf7-aec3-9d2dd7db2310 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.432789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.433515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.433782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.434066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.435888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.437911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.461848 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1270/2553] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:12 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:12.466225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.478884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cabb0-319b-4ccd-a85f-81796ac11e54 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.484143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.484756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.485050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.485333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.486102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.487856 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.503416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1284/2554] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:12.505638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.521532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d408bc-2b6d-4a69-8408-92e9093a5031 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.527307 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.528268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.528550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.528829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] PATH_INFO: `/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9/users/0b6083709e8a4e39b89c4cf76e5891f5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.546158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7753a8ee828489ea6cdcb5dc08db1a9, user_id=0b6083709e8a4e39b89c4cf76e5891f5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.548970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.562956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1271/2555] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:12 2022] PUT /identity/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9/users/0b6083709e8a4e39b89c4cf76e5891f5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:12.567282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.579275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2ebd-6738-469e-9b30-e383ee417976 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.644286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.644976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.645267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.645550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.646296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.648607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a98219-9c6c-41f1-8951-12f85dcda9a4 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.660884 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1285/2556] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:12.664815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.675663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180c1d1-08d7-4c9d-9563-73839e5377d8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.681334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.682246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.682536 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.682876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] PATH_INFO: `/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9/users/0b6083709e8a4e39b89c4cf76e5891f5/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.685050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7753a8ee828489ea6cdcb5dc08db1a9, user_id=0b6083709e8a4e39b89c4cf76e5891f5, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.687891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.699039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1272/2557] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:12 2022] PUT /identity/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9/users/0b6083709e8a4e39b89c4cf76e5891f5/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:12.711142 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.711472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.711758 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.739218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] MFA Rules not processed for user `0b6083709e8a4e39b89c4cf76e5891f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:12.740379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:12.808481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1286/2558] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:12 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:12.821557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.823343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:12.884425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8ab3-42a6-4d76-ac31-7b0bf28b0bde admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:12.888222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:12.888889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:12.889173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:12.889450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:12.899627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:12.901069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:12.910237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1273/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:12.988590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:12.998382 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e17400-a0f7-4195-bdeb-90d4eb2f3667 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:13.001853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:13.002493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:13.002776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:13.003087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:13.058593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:13.060101 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76081ca7-0d59-4878-80d4-aba8c0a709ff service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:13.068975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1287/2560] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:15.762479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:15.825404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17ce41-90ea-42c7-87ff-2fbd21f0baa5 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:15.830017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:15.830882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:15.831192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:15.831512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] PATH_INFO: `/v3/users/8e6960eeb6484077ad8ab3d55de62613` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:15.832719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6960eeb6484077ad8ab3d55de62613)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:15.834663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:15.881702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6960eeb6484077ad8ab3d55de62613'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:15.890358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6960eeb6484077ad8ab3d55de62613'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:15.903769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6960eeb6484077ad8ab3d55de62613'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:15.904353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6960eeb6484077ad8ab3d55de62613'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:15.904961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6960eeb6484077ad8ab3d55de62613'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:15.917091 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1274/2561] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:15 2022] DELETE /identity/v3/users/8e6960eeb6484077ad8ab3d55de62613 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:15.921736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:15.922227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:15.922336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:15.939420 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:15.940629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:16.004059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1288/2562] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:16.014252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:16.015685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:16.070356 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6837d-65df-46ee-8231-fff4d897caba admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:16.074025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:16.074737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:16.074956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:16.075533 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:16.084498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:16.086671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:16.097208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1275/2563] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:16.468929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:16.471412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:16.504996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc6a21-b208-41a0-8bc0-925ddbe6bbcb None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:16.510698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:16.511597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:16.511886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:16.512165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] PATH_INFO: `/v3/projects/74cd9f51027540dea9db6900f2189e0b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:16.513347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cd9f51027540dea9db6900f2189e0b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:16.521716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:16.568404 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cd9f51027540dea9db6900f2189e0b', 'request_id': 'req-6b1241dd-d435-4d75-afa9-601b486983f0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.576286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cd9f51027540dea9db6900f2189e0b', 'request_id': 'req-6b1241dd-d435-4d75-afa9-601b486983f0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.583423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cd9f51027540dea9db6900f2189e0b', 'request_id': 'req-6b1241dd-d435-4d75-afa9-601b486983f0'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.594888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] The token cache is being invalidate because project 74cd9f51027540dea9db6900f2189e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:16.595175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.595863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.597466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1289/2564] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:16 2022] DELETE /identity/v3/projects/74cd9f51027540dea9db6900f2189e0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:16.602046 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:16.611792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d15c9f-ba98-4ba0-80ae-c50b52c973f1 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:16.666365 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:16.667292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:16.667557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:16.667837 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] PATH_INFO: `/v3/users/0b6083709e8a4e39b89c4cf76e5891f5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:16.669027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6083709e8a4e39b89c4cf76e5891f5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:16.670977 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:16.714548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6083709e8a4e39b89c4cf76e5891f5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.721468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6083709e8a4e39b89c4cf76e5891f5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.733496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6083709e8a4e39b89c4cf76e5891f5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.734153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6083709e8a4e39b89c4cf76e5891f5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.734772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-02676404-6386-4acb-9a17-beff7209bec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6083709e8a4e39b89c4cf76e5891f5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:16.747129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1276/2565] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:16 2022] DELETE /identity/v3/users/0b6083709e8a4e39b89c4cf76e5891f5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:17.020351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.022228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:17.036198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1241dd-d435-4d75-afa9-601b486983f0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.094437 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.095309 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.095632 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.095912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] PATH_INFO: `/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.097105 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7753a8ee828489ea6cdcb5dc08db1a9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.099006 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.144033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7753a8ee828489ea6cdcb5dc08db1a9', 'request_id': 'req-7b2d337c-88ef-47f0-9774-bd33091bf809'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:17.152212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7753a8ee828489ea6cdcb5dc08db1a9', 'request_id': 'req-7b2d337c-88ef-47f0-9774-bd33091bf809'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:17.159247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7753a8ee828489ea6cdcb5dc08db1a9', 'request_id': 'req-7b2d337c-88ef-47f0-9774-bd33091bf809'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:17.172429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] The token cache is being invalidate because project e7753a8ee828489ea6cdcb5dc08db1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:17.172776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:17.173411 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7b2d337c-88ef-47f0-9774-bd33091bf809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:17.174978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1290/2566] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:17 2022] DELETE /identity/v3/projects/e7753a8ee828489ea6cdcb5dc08db1a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:17.179978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.180520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.180620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.197858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:17.199005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:17.257935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1277/2567] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:17.265857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.266148 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.266454 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.285429 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:17.287476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:17.296335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1291/2568] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:17.300483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.310348 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79c219-ee65-4f38-86b8-1673e96e5e38 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.315508 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.316209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.316498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.316777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.317578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:17.317896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.320162 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.336594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1278/2569] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:17.337891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.347965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549723bf-145c-4c8a-87d6-73c32ed58cc5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.352933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.353626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.353941 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.354220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.354943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.356923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.391423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1292/2570] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:17.392782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.404423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0519d-f88b-4ecc-bd55-9784c14102ae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.469640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.470613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.470901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.471194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.471961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.474006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.496518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1279/2571] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:17.501634 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.514851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c1dc-fb6a-4f50-a240-c9ad85fb19ef admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.519972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.520629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.520923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.521205 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.522033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.524711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.540772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1293/2572] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:17.544628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.556278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416d8bc-c61a-46d1-8f74-9f1b83d01a1f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.562374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.567404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.567745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.568034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.569461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.571950 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6f754-5e9d-495c-a863-a2ccbec5ecda admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.585518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1280/2573] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:17.589371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.601233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbb4e1-5d9f-4a27-8325-ce588010c45f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.606572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.608275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.608580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.608932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] PATH_INFO: `/v3/projects/1fbe2d45e69f43349060513a1b3938a8/users/fcdde79a65f445b1bddf69bd211fd935/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.625081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbe2d45e69f43349060513a1b3938a8, user_id=fcdde79a65f445b1bddf69bd211fd935, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.628099 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.646653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1294/2574] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:17 2022] PUT /identity/v3/projects/1fbe2d45e69f43349060513a1b3938a8/users/fcdde79a65f445b1bddf69bd211fd935/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:17.657322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.657672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.657960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.687423 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] MFA Rules not processed for user `fcdde79a65f445b1bddf69bd211fd935`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:17.688612 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:17.760701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1281/2575] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:17.766127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.836193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcdbf9-96b2-4842-b949-951b983490fc admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.843746 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.844427 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.844720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.845003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.845793 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.847761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.881825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1295/2576] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:17.886380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.900979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d1c60-5c73-4404-8ffa-8ca55042f664 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:17.959193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:17.960438 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:17.961089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:17.961089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:17.961672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:17.963625 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:17.982520 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1282/2577] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:17 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:17.986665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:17.998545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05b76f-c52d-455f-a568-b82990827aa3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.003119 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.003811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.004097 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.004374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.005100 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.006727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.017950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1296/2578] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:18.022072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.032948 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d246-a636-4b6e-9ccd-ff86d9f67dfc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.037644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.039089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.039400 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.039685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] PATH_INFO: `/v3/projects/e44590ac718c44f4a12e1109c51b02ef/users/081ca81b396348b1ace8945f07e2f607/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.053938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44590ac718c44f4a12e1109c51b02ef, user_id=081ca81b396348b1ace8945f07e2f607, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.056679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.072513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1283/2579] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:18 2022] PUT /identity/v3/projects/e44590ac718c44f4a12e1109c51b02ef/users/081ca81b396348b1ace8945f07e2f607/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:18.076987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.087504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66e183-8f16-4e91-b39f-ae968db0ed0b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.142218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.142885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.143171 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.143482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.144209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.145792 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c2d8d-1065-48a0-91c2-02616a14fcbb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.156067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1297/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:18.160234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.172034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9021a43-216a-40a0-83e0-be1d4be059dd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.176824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.177728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.178016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.178301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] PATH_INFO: `/v3/projects/e44590ac718c44f4a12e1109c51b02ef/users/081ca81b396348b1ace8945f07e2f607/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.181374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44590ac718c44f4a12e1109c51b02ef, user_id=081ca81b396348b1ace8945f07e2f607, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.184447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.195801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1284/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:18 2022] PUT /identity/v3/projects/e44590ac718c44f4a12e1109c51b02ef/users/081ca81b396348b1ace8945f07e2f607/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:18.206514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.206812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.207093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.234555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] MFA Rules not processed for user `081ca81b396348b1ace8945f07e2f607`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:18.235784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:18.302365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1298/2582] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:18.314643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.316506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:18.375962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d39c36-8f22-4348-a8ba-66f93aec3d75 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.379708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.380366 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.380653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.380934 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.390723 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.392189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc05d3-14cc-4eb4-8520-7f1098336b13 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.401617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1285/2583] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:18.430074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.493090 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b28836-8cf3-486a-bd1e-9923665c2fff None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.497855 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.498737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.499023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.499303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] PATH_INFO: `/v3/users/fcdde79a65f445b1bddf69bd211fd935` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.500787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcdde79a65f445b1bddf69bd211fd935)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.502712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.549021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcdde79a65f445b1bddf69bd211fd935'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:18.549917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcdde79a65f445b1bddf69bd211fd935'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:18.562117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcdde79a65f445b1bddf69bd211fd935'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:18.562821 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcdde79a65f445b1bddf69bd211fd935'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:18.570183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcdde79a65f445b1bddf69bd211fd935'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:18.582752 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1299/2584] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:18 2022] DELETE /identity/v3/users/fcdde79a65f445b1bddf69bd211fd935 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:18.588756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.589130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.589551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.609698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:18.611277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:18.670931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1286/2585] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:18.681509 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:18.683063 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:18.745162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04e59a-cec7-407f-8b9f-8ec853bf0a9f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:18.749025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:18.749684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:18.749972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:18.750447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:18.760292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:18.761735 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:18.772291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1300/2586] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:19.064771 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.070239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:19.081272 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f9ac8-4f82-4341-99e5-0ad621785f6d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:19.086655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:19.087630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.087914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.088192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] PATH_INFO: `/v3/projects/1fbe2d45e69f43349060513a1b3938a8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.089833 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbe2d45e69f43349060513a1b3938a8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:19.091795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:19.138173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbe2d45e69f43349060513a1b3938a8', 'request_id': 'req-09201c61-dca9-4c7c-8d07-d62a5aabf89c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.144167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbe2d45e69f43349060513a1b3938a8', 'request_id': 'req-09201c61-dca9-4c7c-8d07-d62a5aabf89c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.151567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbe2d45e69f43349060513a1b3938a8', 'request_id': 'req-09201c61-dca9-4c7c-8d07-d62a5aabf89c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.161547 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] The token cache is being invalidate because project 1fbe2d45e69f43349060513a1b3938a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:19.161835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.162507 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.164706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1287/2587] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:19 2022] DELETE /identity/v3/projects/1fbe2d45e69f43349060513a1b3938a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:19.168697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.178209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6371067-8ee1-4b85-a5be-993f5827f4e1 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:19.235193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:19.236093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.236381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.236661 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] PATH_INFO: `/v3/users/081ca81b396348b1ace8945f07e2f607` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.237843 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=081ca81b396348b1ace8945f07e2f607)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:19.239796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:19.285980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081ca81b396348b1ace8945f07e2f607'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.286678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081ca81b396348b1ace8945f07e2f607'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.298680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081ca81b396348b1ace8945f07e2f607'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.299400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081ca81b396348b1ace8945f07e2f607'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.306719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2d732b00-fef9-424a-8e9b-34551b03e5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081ca81b396348b1ace8945f07e2f607'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.318786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1301/2588] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:19 2022] DELETE /identity/v3/users/081ca81b396348b1ace8945f07e2f607 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:19.590886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.592390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:19.606911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09201c61-dca9-4c7c-8d07-d62a5aabf89c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:19.664436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:19.665328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.665620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.665901 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] PATH_INFO: `/v3/projects/e44590ac718c44f4a12e1109c51b02ef` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.667106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44590ac718c44f4a12e1109c51b02ef)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:19.669064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:19.715483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44590ac718c44f4a12e1109c51b02ef', 'request_id': 'req-6b3577b9-999c-403e-a71b-1fc22d480bef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.721721 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44590ac718c44f4a12e1109c51b02ef', 'request_id': 'req-6b3577b9-999c-403e-a71b-1fc22d480bef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.729657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44590ac718c44f4a12e1109c51b02ef', 'request_id': 'req-6b3577b9-999c-403e-a71b-1fc22d480bef'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.740298 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] The token cache is being invalidate because project e44590ac718c44f4a12e1109c51b02ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:19.740592 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.741714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6b3577b9-999c-403e-a71b-1fc22d480bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:19.743293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1288/2589] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:19 2022] DELETE /identity/v3/projects/e44590ac718c44f4a12e1109c51b02ef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:56:19.748240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.748544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.748835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.767697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:19.768918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:19.829906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1302/2590] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:19.839686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.840001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.840401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.860480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:19.861742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:19.870784 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1289/2591] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:19.875466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.887157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc548c-2778-4390-922a-61575ad9b16d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:19.891824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:19.892488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.892777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.893056 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.893929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:19.894240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:19.896234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:19.909677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1303/2592] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:19.914650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.924192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f9cde-d8a7-475c-8a74-1788eeefe801 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:19.931661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:19.932450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:19.932811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:19.933161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:19.933952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:19.935999 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:19.963170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1290/2593] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:19 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:19.967692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:19.978666 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac43b-5ec5-4a40-8a5f-774c212e4e6d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.034719 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.035441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.035737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.036023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.036721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.039859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.060508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1304/2594] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:19 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:20.064668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.076493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1c1-3ed0-4951-a7c2-4aadc12174af admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.081263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.082128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.082535 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.082820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.083589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.085899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.096666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1291/2595] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:20.100980 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.115972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd673ea0-125d-492a-ae0d-5cd2a4de3e87 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.121836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.122526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.122771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.123054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.123837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.125504 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c9135-c3de-4c99-ac20-50df4bc27fe2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.138303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1305/2596] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:20.142310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.152974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a5f2-5e49-4f8c-97a7-19ee9ff488cf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.157798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.158817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.159102 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.159525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] PATH_INFO: `/v3/projects/210b644907ae410483a4c9ab4d43772d/users/7f684e9662f94ead934fe8f3a7517f85/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.177869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=210b644907ae410483a4c9ab4d43772d, user_id=7f684e9662f94ead934fe8f3a7517f85, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.177869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.191972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1292/2597] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:20 2022] PUT /identity/v3/projects/210b644907ae410483a4c9ab4d43772d/users/7f684e9662f94ead934fe8f3a7517f85/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:20.202876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.203418 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.203543 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.233185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] MFA Rules not processed for user `7f684e9662f94ead934fe8f3a7517f85`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:20.234381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:20.296368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1306/2598] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:20.301131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.376638 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e2d68-3b16-41fe-951a-20128fbb02dd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.382228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.383081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.383392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.383691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.384442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.386430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.416990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1293/2599] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:20 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:20.418963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.431831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067af92a-08bb-4ce6-9c76-263bd74c1b6b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.492451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.493211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.493464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.493738 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.494441 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.496401 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.517132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1307/2600] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:20 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:20.521238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.536787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af50292-fca2-455e-8fd2-140d34171ec0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.542713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.543389 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.543762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.543966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.544799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.546325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.558670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1294/2601] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:20.562807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.573397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849b644-6a4a-4786-bcee-4ac9e193daaf admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.578592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.579576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.579866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.580145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] PATH_INFO: `/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970/users/f467ae96749b42d2b6f5edb900437348/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.596415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcfa8acc6d84bd9bad1d0c1a5ee5970, user_id=f467ae96749b42d2b6f5edb900437348, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.599109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.612256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1308/2602] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:20 2022] PUT /identity/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970/users/f467ae96749b42d2b6f5edb900437348/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:20.618435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.630646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f9c08-af76-43d0-b656-4027b9c6f50d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.686156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.686919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.687093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.687408 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.688144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.689754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8338e58-6ebe-4ec4-ad07-c7334cc69915 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.699506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1295/2603] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:20.704031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.715861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c752a1-3797-49a1-a5e9-76029ed9caa3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.721419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.722514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.722918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.723210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] PATH_INFO: `/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970/users/f467ae96749b42d2b6f5edb900437348/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.725224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcfa8acc6d84bd9bad1d0c1a5ee5970, user_id=f467ae96749b42d2b6f5edb900437348, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.728519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.738756 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1309/2604] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:20 2022] PUT /identity/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970/users/f467ae96749b42d2b6f5edb900437348/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:20.749762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.750052 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.750333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.777611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] MFA Rules not processed for user `f467ae96749b42d2b6f5edb900437348`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:20.778831 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:20.847792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1296/2605] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:20.858546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:20.860336 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:20.918446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562f06a-6121-4f32-bc93-177f83495a47 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:20.922394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:20.923064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:20.923602 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:20.923892 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:20.934642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:20.936137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898cd33-73ca-46fd-86f1-08e74398ac82 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:20.946184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1310/2606] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:21.375225 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:21.443732 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8f923-bae2-44f7-b6b7-f711b5c24dc1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:21.449183 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:21.450313 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:21.450615 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:21.450884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] PATH_INFO: `/v3/users/7f684e9662f94ead934fe8f3a7517f85` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:21.452133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f684e9662f94ead934fe8f3a7517f85)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:21.454079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:21.503546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f684e9662f94ead934fe8f3a7517f85'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:21.512354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f684e9662f94ead934fe8f3a7517f85'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:21.525394 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f684e9662f94ead934fe8f3a7517f85'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:21.526249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f684e9662f94ead934fe8f3a7517f85'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:21.526949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f684e9662f94ead934fe8f3a7517f85'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:21.539652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1297/2607] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:21 2022] DELETE /identity/v3/users/7f684e9662f94ead934fe8f3a7517f85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:21.544268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:21.544858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:21.544858 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:21.570296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:21.573247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:21.637036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1311/2608] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:21.646822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:21.648449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:21.705899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2aa29-3410-4cb3-a088-ade2ec202323 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:21.709915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:21.710577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:21.710941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:21.711142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:21.720608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:21.722054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:21.731846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1298/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:22.089194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:22.090751 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:22.106945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dad685-0ce8-48f3-8233-099e2f8a0fb5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:22.111982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:22.112860 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.113177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.113470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] PATH_INFO: `/v3/projects/210b644907ae410483a4c9ab4d43772d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.114628 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=210b644907ae410483a4c9ab4d43772d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:22.117346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:22.164061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210b644907ae410483a4c9ab4d43772d', 'request_id': 'req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.171125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210b644907ae410483a4c9ab4d43772d', 'request_id': 'req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.177225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210b644907ae410483a4c9ab4d43772d', 'request_id': 'req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.188174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] The token cache is being invalidate because project 210b644907ae410483a4c9ab4d43772d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:22.188451 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.189092 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.190624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1312/2610] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:22 2022] DELETE /identity/v3/projects/210b644907ae410483a4c9ab4d43772d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:22.195310 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:22.206403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a446ef5-34bf-48f3-9d95-6d6b4dd3434a service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:22.265563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:22.266362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.266650 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.266933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] PATH_INFO: `/v3/users/f467ae96749b42d2b6f5edb900437348` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.268191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f467ae96749b42d2b6f5edb900437348)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:22.270135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:22.316767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f467ae96749b42d2b6f5edb900437348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.327207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f467ae96749b42d2b6f5edb900437348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.339750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f467ae96749b42d2b6f5edb900437348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.340407 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f467ae96749b42d2b6f5edb900437348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.341020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-bcaac4b7-33ff-446f-bde2-ee24360f737d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f467ae96749b42d2b6f5edb900437348'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.354260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1299/2611] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:22 2022] DELETE /identity/v3/users/f467ae96749b42d2b6f5edb900437348 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:22.642188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:22.643769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:22.665604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbce3df-896a-4936-a0f8-b2fc2df66e3f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:22.731218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:22.732213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.732572 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.732924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] PATH_INFO: `/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.734236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcfa8acc6d84bd9bad1d0c1a5ee5970)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:22.736181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:22.785088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcfa8acc6d84bd9bad1d0c1a5ee5970', 'request_id': 'req-05b832b3-cade-4a21-9460-3361b8d34bb8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.793410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcfa8acc6d84bd9bad1d0c1a5ee5970', 'request_id': 'req-05b832b3-cade-4a21-9460-3361b8d34bb8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.799721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcfa8acc6d84bd9bad1d0c1a5ee5970', 'request_id': 'req-05b832b3-cade-4a21-9460-3361b8d34bb8'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.810357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] The token cache is being invalidate because project 9fcfa8acc6d84bd9bad1d0c1a5ee5970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:22.810657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.811317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-05b832b3-cade-4a21-9460-3361b8d34bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:22.812929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1313/2612] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:22 2022] DELETE /identity/v3/projects/9fcfa8acc6d84bd9bad1d0c1a5ee5970 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:22.817800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.818264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.818362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.836717 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:22.837937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:22.908930 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1300/2613] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:22.919773 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.920064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.920349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.939054 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:22.940290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:22.948273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1314/2614] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:22.953139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:22.963905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957375-b26e-42aa-837e-a1f3929e72be None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:22.968449 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:22.969100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:22.969383 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:22.969657 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:22.970385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:22.970872 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:22.972644 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:22.985287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1301/2615] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:22.989484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:22.999176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3a9a4-f61c-423a-b996-b44fa5007a07 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.003861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.004503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.004789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.005067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.005766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.008408 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.033556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1315/2616] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:22 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:23.037777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.048060 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37af3d8-f7b4-4a7b-80f3-08129618817e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.105964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.106636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.106920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.107198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.107935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.110175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.134526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1302/2617] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:23 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:23.135799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.146089 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dafea-67c0-4775-8dd5-41820c99b285 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.150822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.151518 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.151812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.152094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.152841 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.154428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.164670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1316/2618] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:23.169012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.180177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812c476-d5fa-40c5-bc4a-2ae72695af1e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.185147 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.185840 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.186126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.186447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.187229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.189196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951383c-198f-478c-b81d-1b5914a824f0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.200585 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1303/2619] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:23.204565 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.216182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1819f-4b6b-40eb-8214-ae84028c36b5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.220840 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.221715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.222001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.222301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] PATH_INFO: `/v3/projects/3807b397f15f4887887bc231b5bccb66/users/f199fee1385e459682d46f1c4f076fed/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.237381 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807b397f15f4887887bc231b5bccb66, user_id=f199fee1385e459682d46f1c4f076fed, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.240069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.255872 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1317/2620] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:23 2022] PUT /identity/v3/projects/3807b397f15f4887887bc231b5bccb66/users/f199fee1385e459682d46f1c4f076fed/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:23.266390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.266769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.267194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.294986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] MFA Rules not processed for user `f199fee1385e459682d46f1c4f076fed`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:23.296158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:23.361390 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1304/2621] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:23.372433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.374137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:23.429459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e89b-2754-46ad-9577-35c37590c9f1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.433372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.434036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.434325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.434607 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.443757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.445831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc9e9a-e74c-41ce-b05a-a07ddd993d81 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.456684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1318/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:23.476128 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.543325 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9aa40-a380-4e31-91e1-2a9ec4dfa915 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.548017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.548821 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.549107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.549378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] PATH_INFO: `/v3/users/f199fee1385e459682d46f1c4f076fed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.550595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f199fee1385e459682d46f1c4f076fed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.553167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.602878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f199fee1385e459682d46f1c4f076fed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:23.610270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f199fee1385e459682d46f1c4f076fed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:23.622372 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f199fee1385e459682d46f1c4f076fed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:23.623119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f199fee1385e459682d46f1c4f076fed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:23.623764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f199fee1385e459682d46f1c4f076fed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:23.638190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1305/2623] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:23 2022] DELETE /identity/v3/users/f199fee1385e459682d46f1c4f076fed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:23.642593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.643121 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.643222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.661523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:23.662797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:23.729926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1319/2624] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:23.737096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:23.738514 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:23.798805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eab6d7-21d4-4a3f-93f7-c082b4c99bd6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:23.803028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:23.804257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:23.804550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:23.804830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:23.815132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:23.816609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e247ee-be38-404f-8748-976943675f04 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:23.828907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1306/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:24.116725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.118448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:24.133533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6072a-2e1b-48a2-af21-f2c51b81508c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.138286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.139144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.139470 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.139757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] PATH_INFO: `/v3/projects/3807b397f15f4887887bc231b5bccb66` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.141031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3807b397f15f4887887bc231b5bccb66)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.142887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.191674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3807b397f15f4887887bc231b5bccb66', 'request_id': 'req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:24.199155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3807b397f15f4887887bc231b5bccb66', 'request_id': 'req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:24.205823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3807b397f15f4887887bc231b5bccb66', 'request_id': 'req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:24.217017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] The token cache is being invalidate because project 3807b397f15f4887887bc231b5bccb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:24.217310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:24.217962 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-2fa0912a-d7e2-488b-a09a-e65c4223d5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:24.219529 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1320/2626] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:24 2022] DELETE /identity/v3/projects/3807b397f15f4887887bc231b5bccb66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:24.224384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.224758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.225043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.242161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:24.243344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:24.301993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1307/2627] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:24.310293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.310590 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.310878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.331071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:24.332255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:24.341474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1321/2628] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:24.345846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.357682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b4d39-2089-40ad-a47f-1d0f611b942a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.362261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.362913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.363197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.363498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.364227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:24.364537 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.366403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.378251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1308/2629] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:24.383174 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.392538 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1896d0e-24b5-4898-8bdb-739f6fbb8154 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.397945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.398610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.398928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.399197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.399940 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.401844 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.426293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1322/2630] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:24 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:24.432555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.442540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09fa90-1b53-4499-b123-c1746858b6bc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.500792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.501482 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.501770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.502049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.502767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.504743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.527105 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1309/2631] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:24 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:24.531990 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.543999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e0b67-8f1a-4669-a52a-d17753590a09 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.548692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.549368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.549659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.549936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.550677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.552328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.563239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1323/2632] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:24.567647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.578278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6c08a-3a7f-4c59-a061-699af5209e55 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.583078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.583762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.584065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.584377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.585661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.587526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eab837-9b88-43cb-8f70-c314c055aec0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.598187 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1310/2633] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:24.603064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.613041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce429-1f13-43d2-b2f9-dfe78f6fe350 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.617911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.618796 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.619083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.619390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] PATH_INFO: `/v3/projects/995a8e02b9594c82b43bca683937d177/users/509509fd9f7f4dec84337ee560af1002/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.634130 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=995a8e02b9594c82b43bca683937d177, user_id=509509fd9f7f4dec84337ee560af1002, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.636848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.652150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1324/2634] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:24 2022] PUT /identity/v3/projects/995a8e02b9594c82b43bca683937d177/users/509509fd9f7f4dec84337ee560af1002/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:24.662414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.662710 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.663621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.689886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] MFA Rules not processed for user `509509fd9f7f4dec84337ee560af1002`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:24.691144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:24.755604 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1311/2635] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:24.767329 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:24.769061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:24.827517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039bf46-ac60-4d96-8f7c-4402f278d32c admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:24.832779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:24.833526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:24.833755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:24.834035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:24.843973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:24.845405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159106-ffad-4af0-b85d-060c4fc93a87 service glance] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:24.856177 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1325/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:48.939143 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:48.940628 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:49.009156 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4391-2a4c-445e-a219-ed336504f637 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:49.014526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:49.015433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:49.015729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:49.016012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] PATH_INFO: `/v3/users/224e374464b94aaa80d8ab19427a2192` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:49.017261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=224e374464b94aaa80d8ab19427a2192)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:49.019204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:49.068212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224e374464b94aaa80d8ab19427a2192'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.075896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224e374464b94aaa80d8ab19427a2192'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.088443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224e374464b94aaa80d8ab19427a2192'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.089159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224e374464b94aaa80d8ab19427a2192'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.090518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224e374464b94aaa80d8ab19427a2192'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.102326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1312/2637] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:48 2022] DELETE /identity/v3/users/224e374464b94aaa80d8ab19427a2192 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:49.107862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108daf-7850-477e-8058-23a1045ca30b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:49.108638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108daf-7850-477e-8058-23a1045ca30b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:49.108638 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108daf-7850-477e-8058-23a1045ca30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:49.125610 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-72108daf-7850-477e-8058-23a1045ca30b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:49.126755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-72108daf-7850-477e-8058-23a1045ca30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:49.188946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1326/2638] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:49.199324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:49.201092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:49.256177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb2f44-da05-4f76-b168-81e5171a4fe0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:49.261093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:49.262478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:49.262766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:49.263043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:49.272374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:49.273804 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:49.283589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1313/2639] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:49.556625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108daf-7850-477e-8058-23a1045ca30b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:49.559464 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-72108daf-7850-477e-8058-23a1045ca30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:49.573924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108daf-7850-477e-8058-23a1045ca30b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:49.580039 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:49.585817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:49.586117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:49.586407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] PATH_INFO: `/v3/projects/430379e3acc443778a206d97d80184d9` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:49.587700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430379e3acc443778a206d97d80184d9)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:49.590392 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:49.639851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430379e3acc443778a206d97d80184d9', 'request_id': 'req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.647040 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430379e3acc443778a206d97d80184d9', 'request_id': 'req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.653243 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430379e3acc443778a206d97d80184d9', 'request_id': 'req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.663178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] The token cache is being invalidate because project 430379e3acc443778a206d97d80184d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:49.663505 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.664155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.665687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1327/2640] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:49 2022] DELETE /identity/v3/projects/430379e3acc443778a206d97d80184d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:49.670380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:49.680229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9b8f-7dcd-4e7c-bcf8-582cc50f154b service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:49.737111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:49.737983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:49.738274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:49.738550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] PATH_INFO: `/v3/users/0a4117a1c7054aba924aac23437ee488` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:49.739808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4117a1c7054aba924aac23437ee488)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:49.741744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:49.786411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4117a1c7054aba924aac23437ee488'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.793252 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4117a1c7054aba924aac23437ee488'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.804499 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4117a1c7054aba924aac23437ee488'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.805152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4117a1c7054aba924aac23437ee488'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.805777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3fafdc6a-0acb-4af7-ad5f-bf5c08d53ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4117a1c7054aba924aac23437ee488'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:49.818699 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1314/2641] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:49 2022] DELETE /identity/v3/users/0a4117a1c7054aba924aac23437ee488 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:50.089673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.091348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.112809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1527-bd26-416e-a6bf-0ff1e1fffd38 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.177371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.178253 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.178522 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.178794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] PATH_INFO: `/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.180018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590dbbf63f9f42d7bf24d60a84f1f472)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.181934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.231156 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590dbbf63f9f42d7bf24d60a84f1f472', 'request_id': 'req-16439cee-6537-4e3a-83e5-d795894e44a1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:50.240973 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590dbbf63f9f42d7bf24d60a84f1f472', 'request_id': 'req-16439cee-6537-4e3a-83e5-d795894e44a1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:50.247559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590dbbf63f9f42d7bf24d60a84f1f472', 'request_id': 'req-16439cee-6537-4e3a-83e5-d795894e44a1'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:50.258019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] The token cache is being invalidate because project 590dbbf63f9f42d7bf24d60a84f1f472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:50.258315 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:50.259044 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-16439cee-6537-4e3a-83e5-d795894e44a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:50.260644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1328/2642] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:50 2022] DELETE /identity/v3/projects/590dbbf63f9f42d7bf24d60a84f1f472 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:56:50.267601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.268113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.268238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.287352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:50.288630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.349380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1315/2643] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:50.357264 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.357560 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.357845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.376478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:50.377677 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.385667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1329/2644] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:50.390526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.400154 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9a7e7-e848-4616-8755-791484b115ec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.405497 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.406145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.406431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.406707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.407566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:50.407875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.409468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.421211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1316/2645] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:50.425487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.435314 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc7041-b22e-455e-b8d1-07eba1bdfcb3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.439942 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.440593 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.440882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.441164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.441865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.443838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.472981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1330/2646] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:50.474077 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.484478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6d6f-624c-492a-b91d-8e8dd16001c4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.539284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.539992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.540280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.540559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.541264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.543748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.564071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1317/2647] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:50.568186 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.579956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a45e1-5e4f-406c-a5de-212d3b32b7a5 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.580180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.581859 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.584657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.585323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.585613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.585893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.586624 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.588245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.602596 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1331/2648] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:50.603926 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.614138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924edf-2d89-4f58-b9f9-1c86d65432b8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.619131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.619836 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.620120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.620443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.621419 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.623022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.633594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1332/2649] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:50.638410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.642524 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954a81-22e8-44be-85ac-25aa44704c8d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.646261 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.646941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.647229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.647539 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.648153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f074a-797e-4410-906d-1119a3591077 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.649327 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.653282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.654302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.654578 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.654876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] PATH_INFO: `/v3/projects/f2acacc2e16743f589c4bb5929cf9a87/users/2c2b01e667404212a424b15a330b609e/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.671127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2acacc2e16743f589c4bb5929cf9a87, user_id=2c2b01e667404212a424b15a330b609e, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.673833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010b0b1-041c-4fb9-9148-f3251ebd7e3e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.698164 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1333/2650] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:50 2022] PUT /identity/v3/projects/f2acacc2e16743f589c4bb5929cf9a87/users/2c2b01e667404212a424b15a330b609e/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:56:50.708566 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.708865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.709155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.719250 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.720728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.730583 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1318/2651] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:56:50.736485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] MFA Rules not processed for user `2c2b01e667404212a424b15a330b609e`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:50.737693 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:50.819583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1334/2652] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:50.824160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:50.880293 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac86b88-3e4a-4fe5-97c4-7aeff31dd33d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:50.959068 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:50.959678 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:50.959967 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:50.960246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:50.960948 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:50.962843 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:50.987955 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1319/2653] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:50.991893 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.002461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5533012-61c6-4b7a-b7d3-f16ffee2648b None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.059465 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.060147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.060469 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.060753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.061462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.063448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.085750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1335/2654] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:50 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:51.088384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.099703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b40b4-090d-4cf8-86af-4a2b5f1c7a99 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.104393 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.105718 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.106017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.106332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.107072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.108801 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.119251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1320/2655] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:51.123385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.133246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bf6d3-ee51-43d3-a555-7a3178e03c10 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.138869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.139786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.140078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.140360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] PATH_INFO: `/v3/projects/bd9d27254a6247969236dea92b6ad26b/users/7835c376d5e644c69fd5c4265ac3bc2f/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.156498 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9d27254a6247969236dea92b6ad26b, user_id=7835c376d5e644c69fd5c4265ac3bc2f, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.159163 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.172030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1336/2656] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:51 2022] PUT /identity/v3/projects/bd9d27254a6247969236dea92b6ad26b/users/7835c376d5e644c69fd5c4265ac3bc2f/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:56:51.176000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.185811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72757b4f-bf3e-4226-b0de-4aa77f7db09b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.240433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.241024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.241314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.241596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.242328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.243964 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d6888-14a1-4f6b-8128-9b07487abd99 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.253823 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1321/2657] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:51.258140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.269115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37578b5d-9ee2-47d9-93b9-ec459235c553 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.273767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.274645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.275049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.275333 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] PATH_INFO: `/v3/projects/bd9d27254a6247969236dea92b6ad26b/users/7835c376d5e644c69fd5c4265ac3bc2f/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.277911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9d27254a6247969236dea92b6ad26b, user_id=7835c376d5e644c69fd5c4265ac3bc2f, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.280594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.290428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1337/2658] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:51 2022] PUT /identity/v3/projects/bd9d27254a6247969236dea92b6ad26b/users/7835c376d5e644c69fd5c4265ac3bc2f/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:51.301397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.301912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.302034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.332270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] MFA Rules not processed for user `7835c376d5e644c69fd5c4265ac3bc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:51.333491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:51.406236 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1322/2659] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:51.427017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.499351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a9f06-18fd-4a8f-b26e-50aca7edef17 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.503775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.504433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.504720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.504996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.515645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.517168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510ad1f-851c-426c-8e24-88a462d18410 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.527923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1338/2660] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:51.593556 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.655014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2369fc-4333-40e2-b2c7-ec7905e76fa0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.659620 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.660491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.660770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.661041 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] PATH_INFO: `/v3/users/2c2b01e667404212a424b15a330b609e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.662254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2b01e667404212a424b15a330b609e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.664197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.710190 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2b01e667404212a424b15a330b609e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:51.717852 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2b01e667404212a424b15a330b609e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:51.729281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2b01e667404212a424b15a330b609e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:51.730455 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2b01e667404212a424b15a330b609e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:51.731159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2b01e667404212a424b15a330b609e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:51.742670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1323/2661] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:51 2022] DELETE /identity/v3/users/2c2b01e667404212a424b15a330b609e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:51.747827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.748189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.748535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.773906 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:51.775029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:51.834432 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1339/2662] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:51.844966 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:51.846467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:51.924704 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbbcf6-f235-42a2-9b0b-44e647f2035a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:51.928501 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:51.929163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:51.929451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:51.929733 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:51.940287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:51.941766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:51.951858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1324/2663] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:52.216346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:52.218300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:52.230182 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4ed38-8318-41ac-85c4-44c6c07712db None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:52.235234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:52.236155 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:52.236461 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:52.236743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] PATH_INFO: `/v3/projects/f2acacc2e16743f589c4bb5929cf9a87` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:52.238311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2acacc2e16743f589c4bb5929cf9a87)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:52.240300 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:52.288010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2acacc2e16743f589c4bb5929cf9a87', 'request_id': 'req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.294982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2acacc2e16743f589c4bb5929cf9a87', 'request_id': 'req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.301237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2acacc2e16743f589c4bb5929cf9a87', 'request_id': 'req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.312080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] The token cache is being invalidate because project f2acacc2e16743f589c4bb5929cf9a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:52.312380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.313022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.314559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1340/2664] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:52 2022] DELETE /identity/v3/projects/f2acacc2e16743f589c4bb5929cf9a87 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:52.318782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:52.329430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9c350-5b7a-4f01-9c04-45f2593e403a service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:52.383960 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:52.384825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:52.385110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:52.385385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] PATH_INFO: `/v3/users/7835c376d5e644c69fd5c4265ac3bc2f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:52.387401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7835c376d5e644c69fd5c4265ac3bc2f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:52.389323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:52.435271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7835c376d5e644c69fd5c4265ac3bc2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.442122 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7835c376d5e644c69fd5c4265ac3bc2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.454564 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7835c376d5e644c69fd5c4265ac3bc2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.455270 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7835c376d5e644c69fd5c4265ac3bc2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.455948 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-000db498-2d03-4534-9665-5e6a2bcd57ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7835c376d5e644c69fd5c4265ac3bc2f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.467810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1325/2665] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:56:52 2022] DELETE /identity/v3/users/7835c376d5e644c69fd5c4265ac3bc2f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:52.770512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:52.772015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:52.787072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a05c4-835b-4b87-a5b0-6f6a27fd1b92 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:52.851430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:52.852375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:52.852658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:52.852939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] PATH_INFO: `/v3/projects/bd9d27254a6247969236dea92b6ad26b` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:52.854161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9d27254a6247969236dea92b6ad26b)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:52.856158 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:52.916651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9d27254a6247969236dea92b6ad26b', 'request_id': 'req-647d81df-0906-44bd-ace0-504eb4e7835d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.926406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9d27254a6247969236dea92b6ad26b', 'request_id': 'req-647d81df-0906-44bd-ace0-504eb4e7835d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.933842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9d27254a6247969236dea92b6ad26b', 'request_id': 'req-647d81df-0906-44bd-ace0-504eb4e7835d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.944763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] The token cache is being invalidate because project bd9d27254a6247969236dea92b6ad26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:56:52.945068 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.945744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-647d81df-0906-44bd-ace0-504eb4e7835d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:56:52.947320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1341/2666] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:56:52 2022] DELETE /identity/v3/projects/bd9d27254a6247969236dea92b6ad26b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:52.952832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:52.953157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:52.953420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:52.973370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:52.974671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:53.046670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1326/2667] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:53.054960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.055157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.055463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.077072 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:53.078285 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:53.086317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1342/2668] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:53.091911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.101890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16797-2c2c-45bf-b0c3-d8cd9360dd5b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.107411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.108108 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.108399 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.108679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.109431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:56:53.109745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.111382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.124028 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1327/2669] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:56:53.128595 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.138003 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f51d-891a-4e0f-8e56-f60e635f87e7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.145589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.146684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.147013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.147312 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.148190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.150531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.179658 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1343/2670] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:53.184419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.194700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e8a04-d6ab-4c92-9ae1-50bef1505dd3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.261260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.261946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.262231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.262512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.263214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.265228 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.288523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1328/2671] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:56:53.291240 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.303083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cccd5-3001-4c4f-8ec6-f800958d7686 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.308591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.309842 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.310192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.310477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.311223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.312912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.329723 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1344/2672] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:53.334003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.345066 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436efd84-8ba3-4aec-aaac-f267c4479dd1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.349861 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.350540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.350920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.351218 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.352001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.353643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac12c2a-bb33-456b-9815-08deae523fc6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.367430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1329/2673] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:56:53.372771 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.382789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063707d1-e6e2-4843-9d76-e85597f5f854 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.388139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.389031 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.389319 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.389597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] PATH_INFO: `/v3/projects/65c57ab59a94463481e45fd81e9d9015/users/134ae20660ab4510bdca886abc7b0e41/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.404071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c57ab59a94463481e45fd81e9d9015, user_id=134ae20660ab4510bdca886abc7b0e41, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.406715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.419811 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1345/2674] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:53 2022] PUT /identity/v3/projects/65c57ab59a94463481e45fd81e9d9015/users/134ae20660ab4510bdca886abc7b0e41/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:53.430273 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.430498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.430775 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.458385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] MFA Rules not processed for user `134ae20660ab4510bdca886abc7b0e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:53.461090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:53.526961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1330/2675] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:56:53.531704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.604178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b6e13-f28c-4efd-bf06-3b202c259127 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.610407 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.611114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.611428 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.611714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.612422 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.614373 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.646176 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1346/2676] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:53.650617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.662680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed07c6-9ab7-4155-b27a-b85becf8d629 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.726593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.727274 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.727603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.727888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.728594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.731788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.752946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1331/2677] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:56:53.757201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.768817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3e004-9fc7-40d5-80d5-a0eadee3bde6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.775691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.776372 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.777260 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.777539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.778276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.779945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.791513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1347/2678] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:53.796388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.807594 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfbdfd-06d7-4f4d-b7fe-a7952dd89660 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.812608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.813512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.813802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.814078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] PATH_INFO: `/v3/projects/8cfe46eacdc644f2a192395ce010d204/users/ec2793a75273430ea6731f6c7bdf6ff2/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.830368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfe46eacdc644f2a192395ce010d204, user_id=ec2793a75273430ea6731f6c7bdf6ff2, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.833132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.847305 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1332/2679] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:53 2022] PUT /identity/v3/projects/8cfe46eacdc644f2a192395ce010d204/users/ec2793a75273430ea6731f6c7bdf6ff2/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:53.851351 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.862231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8775-fa87-4d7c-a8b4-5c5608882e8e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.920376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.921075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.921384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.921665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.922403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.924173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96349f8e-00d2-4090-92ec-909bf2895867 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.934918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1348/2680] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:56:53.939677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:53.951306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434386-c9e3-4622-9e1e-fac051b5a235 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:53.956024 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:53.956942 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.957234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.957512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] PATH_INFO: `/v3/projects/8cfe46eacdc644f2a192395ce010d204/users/ec2793a75273430ea6731f6c7bdf6ff2/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:53.959510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfe46eacdc644f2a192395ce010d204, user_id=ec2793a75273430ea6731f6c7bdf6ff2, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:53.962163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:53.974256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1333/2681] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:56:53 2022] PUT /identity/v3/projects/8cfe46eacdc644f2a192395ce010d204/users/ec2793a75273430ea6731f6c7bdf6ff2/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:56:53.986556 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:53.986852 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:53.987132 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:54.016273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] MFA Rules not processed for user `ec2793a75273430ea6731f6c7bdf6ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:56:54.017519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:54.087814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1349/2682] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:56:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:56:54.099661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:54.101421 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:56:54.159881 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7e0b5-9049-4570-a300-838d6d00a4ae admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:54.163502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:54.164157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:54.164437 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:54.164714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:54.174762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:54.176249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be481e-d929-4a1b-ae10-378d96354bb2 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:54.187410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1334/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:56:54.344468 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:56:54.354270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08762c-54b2-4082-aded-d0cce3d5b7b6 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:56:54.358794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:56:54.359484 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:56:54.359776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:56:54.360133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:56:54.418043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:56:54.419680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:56:54.429345 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1350/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:56:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:08.113380 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:08.113926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:08.113926 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:08.131947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] MFA Rules not processed for user `798edb753845410fa6f9c136b43abf05`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:08.133130 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:08.187062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1335/2685] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:08.506221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:08.508374 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:08.567081 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df83ea-69d3-4484-9b37-f3f50c53c637 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:08.570829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:08.571766 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:08.571897 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:08.572113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:08.574098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:08.594334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:08.596923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:08.610194 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1351/2686] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:09.073138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:09.074981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:09.165839 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c40ff7-3724-488f-b5da-6023fc9a9f7a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:09.171778 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:09.172434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:09.172725 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:09.173009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:09.174850 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:09.187580 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:09.189242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d446bb-883e-4246-8b6c-519a53a512c4 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:09.199772 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1336/2687] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:09.768763 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:09.770192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:09.836049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9b15-e80b-4ac3-b12e-f74e18a41853 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:09.842050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:09.842936 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:09.843220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:09.843533 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] PATH_INFO: `/v3/users/509509fd9f7f4dec84337ee560af1002` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:09.844876 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=509509fd9f7f4dec84337ee560af1002)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:09.846849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:09.893573 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509509fd9f7f4dec84337ee560af1002'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:09.894244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509509fd9f7f4dec84337ee560af1002'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:09.906514 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509509fd9f7f4dec84337ee560af1002'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:09.907229 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509509fd9f7f4dec84337ee560af1002'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:09.914985 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509509fd9f7f4dec84337ee560af1002'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:09.927802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1352/2688] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:09 2022] DELETE /identity/v3/users/509509fd9f7f4dec84337ee560af1002 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:09.932434 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:09.933089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:09.933420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:09.952545 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:09.953750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.015863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1337/2689] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:10.025667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.027066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.048085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.049554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.062020 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6f384-a7bf-4b1c-8608-29c40ada9ad2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.068209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.069078 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.069359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.069728 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] PATH_INFO: `/v3/users/134ae20660ab4510bdca886abc7b0e41` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.071692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] RBAC: Authorizing `identity:delete_user(user_id=134ae20660ab4510bdca886abc7b0e41)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.073045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.093448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca588ad0-c81a-4de3-817a-401fb0f4f9ec admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.097388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.098225 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.099088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.099088 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.111622 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.113417 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a4d04-21f8-4d20-be27-4ab619a89615 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.126659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1353/2690] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:10.127483 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134ae20660ab4510bdca886abc7b0e41'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.135532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134ae20660ab4510bdca886abc7b0e41'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.153211 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134ae20660ab4510bdca886abc7b0e41'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.154291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134ae20660ab4510bdca886abc7b0e41'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.164906 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134ae20660ab4510bdca886abc7b0e41'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.182269 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1338/2691] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:10 2022] DELETE /identity/v3/users/134ae20660ab4510bdca886abc7b0e41 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:10.187124 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.187445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.187761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.209568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:10.211231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.315704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1354/2692] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:57:10.332203 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.333712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.403703 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2592f-c761-46f5-a5cc-280803a6129b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.408319 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.409472 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.409769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.410116 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.425239 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.427037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b2fbd-8835-4f13-beee-9d2a2a1263fa service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.437910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1339/2693] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:10.557043 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.558647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.572443 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecc33a-d00c-447e-a8fa-193ea07bb76f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.578138 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.579235 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.579697 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.580038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] PATH_INFO: `/v3/projects/995a8e02b9594c82b43bca683937d177` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.581453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995a8e02b9594c82b43bca683937d177)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.584201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.638302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995a8e02b9594c82b43bca683937d177', 'request_id': 'req-34fddc8b-b533-481d-b2cd-2e6e49782175'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.647016 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995a8e02b9594c82b43bca683937d177', 'request_id': 'req-34fddc8b-b533-481d-b2cd-2e6e49782175'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.654398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995a8e02b9594c82b43bca683937d177', 'request_id': 'req-34fddc8b-b533-481d-b2cd-2e6e49782175'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.664918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] The token cache is being invalidate because project 995a8e02b9594c82b43bca683937d177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:10.665146 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.665824 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-34fddc8b-b533-481d-b2cd-2e6e49782175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:10.667888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1355/2694] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:10 2022] DELETE /identity/v3/projects/995a8e02b9594c82b43bca683937d177 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:10.673082 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.673687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.674175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.723352 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:10.724677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.793633 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1340/2695] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:10.796025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.796490 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.796604 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.816972 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:10.818251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.827750 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1356/2696] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:10.832484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.849198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072a6c-89af-470f-a205-cec925a2c979 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.854762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.856256 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.857025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.857369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.858208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:57:10.858587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.860335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.869918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.872804 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:10.874763 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1341/2697] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:57:10.881410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:10.894567 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671ad90-f1ce-41b6-affe-73183f2f8d90 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.899959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.900809 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.901344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.901344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.902201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.905100 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.913799 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b814233-bcd7-4c40-a2be-55bcb2e2c90c None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:10.928103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:10.931507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:10.932207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:10.936020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] PATH_INFO: `/v3/projects/65c57ab59a94463481e45fd81e9d9015` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:10.937867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c57ab59a94463481e45fd81e9d9015)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:10.940410 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:10.951410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1342/2698] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:57:10 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:57:10.954370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.005379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c57ab59a94463481e45fd81e9d9015', 'request_id': 'req-df36fb4a-5a6a-443d-99c7-732f0d57d76d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.015265 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c57ab59a94463481e45fd81e9d9015', 'request_id': 'req-df36fb4a-5a6a-443d-99c7-732f0d57d76d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.022086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c57ab59a94463481e45fd81e9d9015', 'request_id': 'req-df36fb4a-5a6a-443d-99c7-732f0d57d76d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.039952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d532cd-4792-4b43-bed2-8b201c6c52f7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.042344 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] The token cache is being invalidate because project 65c57ab59a94463481e45fd81e9d9015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:11.042713 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.053278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.056564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1357/2699] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:10 2022] DELETE /identity/v3/projects/65c57ab59a94463481e45fd81e9d9015 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:11.060537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.063569 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.118593 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.119744 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.121614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.121614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.121614 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.122974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.146322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1343/2700] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:57:10 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:57:11.150846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.154026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.156492 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fb4a-5a6a-443d-99c7-732f0d57d76d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.164181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.165273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.165728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.166222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] PATH_INFO: `/v3/users/ec2793a75273430ea6731f6c7bdf6ff2` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.166791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695735d-a203-4c1e-9f91-0c1a535d923a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.168047 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec2793a75273430ea6731f6c7bdf6ff2)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.171835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.172826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.173519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.173808 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.174089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.175003 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.176652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.191458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1344/2701] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:57:11.195465 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.211106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342b99-0efe-434b-9805-72c9aa857cd9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.220862 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.221643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.221974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.222354 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.223106 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.224805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.240737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1345/2702] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:11.241671 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.247325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec2793a75273430ea6731f6c7bdf6ff2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.248542 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec2793a75273430ea6731f6c7bdf6ff2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.252369 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e1f1-7e7a-44ec-abed-4b5468b18f82 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.258323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.259246 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.259568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.260026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] PATH_INFO: `/v3/projects/f86b8892e7d9409d8846ff058304ee8d/users/c770605519644d2cb4e7aa68ca04a2ac/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.270708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec2793a75273430ea6731f6c7bdf6ff2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.271526 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec2793a75273430ea6731f6c7bdf6ff2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.280072 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86b8892e7d9409d8846ff058304ee8d, user_id=c770605519644d2cb4e7aa68ca04a2ac, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.283651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4051d77-4173-4b6f-8b9a-09d614c08b1a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.291847 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec2793a75273430ea6731f6c7bdf6ff2'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.301444 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1346/2703] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:57:11 2022] PUT /identity/v3/projects/f86b8892e7d9409d8846ff058304ee8d/users/c770605519644d2cb4e7aa68ca04a2ac/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:11.314268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.314819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.315097 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.321140 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1358/2704] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:11 2022] DELETE /identity/v3/users/ec2793a75273430ea6731f6c7bdf6ff2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:57:11.348870 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] MFA Rules not processed for user `c770605519644d2cb4e7aa68ca04a2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:11.351125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.458965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1347/2705] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:57:11.463515 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.465863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.554835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3f9ef-281f-4d46-b24e-97cd286459dd admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.560903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.561594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.561882 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.562162 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.562900 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.565335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.597564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1359/2706] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:57:11 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:57:11.601798 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.615505 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b3e26-a8e8-4c0d-8c1e-70fd5e4ad751 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.678098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.680433 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.696493 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.698192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.698621 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.698909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.700299 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.702640 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.725726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1348/2707] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:57:11 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:57:11.730805 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.742847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7e472-dc3a-4782-92d1-28fcde481a11 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.750223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.751022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.751642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.752007 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.752965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.754713 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.766032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1349/2708] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:11.770000 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.775398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621190ab-3e40-4ea3-b402-6b96ba6d1d52 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.781586 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f058-4393-475e-a016-88675b18618a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.781776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.782486 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.782780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.783062 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] PATH_INFO: `/v3/projects/8cfe46eacdc644f2a192395ce010d204` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.784377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfe46eacdc644f2a192395ce010d204)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.786368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.787133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.787944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.788328 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.788676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.789553 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.791300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.803766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1350/2709] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:11.808031 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:11.818237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35247c-811e-4670-b2ae-99f63415ef89 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:11.824450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:11.825363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.825917 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.826200 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] PATH_INFO: `/v3/projects/344bbefaf7da41049d068cc00b945988/users/018777011f604280ad5c3d376c0cb64c/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.846577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=344bbefaf7da41049d068cc00b945988, user_id=018777011f604280ad5c3d376c0cb64c, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:11.849511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021358-b263-4fd3-abe4-bffab6a6b7da admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:11.849739 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfe46eacdc644f2a192395ce010d204', 'request_id': 'req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.860258 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfe46eacdc644f2a192395ce010d204', 'request_id': 'req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.870116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfe46eacdc644f2a192395ce010d204', 'request_id': 'req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.879903 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1351/2710] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:57:11 2022] PUT /identity/v3/projects/344bbefaf7da41049d068cc00b945988/users/018777011f604280ad5c3d376c0cb64c/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:11.882424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.882706 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.883090 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.884024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] The token cache is being invalidate because project 8cfe46eacdc644f2a192395ce010d204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:11.884327 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.885029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-7d45b4c5-0b95-42ab-8258-a2e24a6bb85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:11.887440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1360/2711] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:11 2022] DELETE /identity/v3/projects/8cfe46eacdc644f2a192395ce010d204 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:57:11.897178 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d630e-2959-4eb3-b68c-e30bd31aed95 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:11.897485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d630e-2959-4eb3-b68c-e30bd31aed95 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:11.897774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d630e-2959-4eb3-b68c-e30bd31aed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:11.922095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-399d630e-2959-4eb3-b68c-e30bd31aed95 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:11.923551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-399d630e-2959-4eb3-b68c-e30bd31aed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:11.929986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] MFA Rules not processed for user `018777011f604280ad5c3d376c0cb64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:11.932186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.002879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1361/2712] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:12.010890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.011455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.012497 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.039023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:12.040757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.051825 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1362/2713] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:57:12.056067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.063546 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1352/2714] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:12.067194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.068962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.069482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f7ee-e9bd-41e1-b32d-2e53e3ed0261 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.076785 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.077611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.078772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.079161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.080495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:57:12.081083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.083268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.110488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1363/2715] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 17:57:12.111807 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.111971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4dda-b0b9-4330-9121-ada9c5394c21 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.123733 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2efa-ab06-4948-9485-a5ac680bb3a8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.124720 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.125462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.125860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.127222 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.127992 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.128696 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.129592 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.129918 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.130189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.131050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.133471 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.134984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.173247 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1364/2716] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:57:12.177964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.201687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1353/2717] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:57:12.204476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.300615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb87066-b75e-44a7-b43a-00b875fc6146 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.311459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.312167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.312457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.312737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.313453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.317534 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6cd8-b716-41a5-9b11-c14b9acfa091 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.319102 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.331071 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.331860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.332159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.332446 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.333157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.335185 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.365352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1365/2718] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:57:12.366488 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.376506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1354/2719] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:57:12.380549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.387700 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe123f04-8d1a-4fd9-ab23-0dda188751b0 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.393524 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.394905 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.395551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.395859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.396565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c2bc-ca17-4775-877b-c79ea2adefc3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.397057 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.399412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.403889 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.404963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.405466 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.405927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.406841 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.408700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.424471 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1355/2720] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:12.428531 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1366/2721] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:12.428686 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.430283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.443447 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83133bf-2ae6-44e0-aeb7-1a0fad992665 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.448510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.449578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.450175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.450510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] PATH_INFO: `/v3/projects/6e682186e70543ab8edd38eaba315b7e/users/f6b4015e407547fd8886923d5a7d1b64/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.452820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1408b-64ca-4c4f-b1e9-67e9e1951e7a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.457959 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.458648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.458938 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.459220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.460170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.461775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.470727 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e682186e70543ab8edd38eaba315b7e, user_id=f6b4015e407547fd8886923d5a7d1b64, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.474006 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.479889 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1367/2722] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:57:12.483084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.495961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182767-379c-4843-a189-a90b66e63347 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.498199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1356/2723] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:57:12 2022] PUT /identity/v3/projects/6e682186e70543ab8edd38eaba315b7e/users/f6b4015e407547fd8886923d5a7d1b64/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:12.502619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.560010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7981-b352-4151-af22-851185658146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.561829 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7981-b352-4151-af22-851185658146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.562571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7981-b352-4151-af22-851185658146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.562896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7981-b352-4151-af22-851185658146 admin admin] PATH_INFO: `/v3/projects/c3d50034a1314d3585785fb8bce4e7f5/users/2b565b3cc3f648d0b707856fa32fc6f7/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.581762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8bbf3-3775-4e3c-a8af-7be4b7462809 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.581964 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7981-b352-4151-af22-851185658146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d50034a1314d3585785fb8bce4e7f5, user_id=2b565b3cc3f648d0b707856fa32fc6f7, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.584775 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7981-b352-4151-af22-851185658146 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.586913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.587623 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.587914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.588197 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.589295 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.592158 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834f94-1386-4531-9227-6a077845d92c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.611459 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1357/2725] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 17:57:12.611675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1368/2725] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:57:12 2022] PUT /identity/v3/projects/c3d50034a1314d3585785fb8bce4e7f5/users/2b565b3cc3f648d0b707856fa32fc6f7/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:12.611675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7981-b352-4151-af22-851185658146 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.615288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.615634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.615923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.647248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] MFA Rules not processed for user `2b565b3cc3f648d0b707856fa32fc6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:12.648548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.679513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7981-b352-4151-af22-851185658146 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.692641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.694513 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.694820 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.695111 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] PATH_INFO: `/v3/projects/6e682186e70543ab8edd38eaba315b7e/users/f6b4015e407547fd8886923d5a7d1b64/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.698060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e682186e70543ab8edd38eaba315b7e, user_id=f6b4015e407547fd8886923d5a7d1b64, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.703223 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f6d1-0f2a-4f59-b314-85c4c48dcaa2 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.723472 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1369/2726] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:57:12 2022] PUT /identity/v3/projects/6e682186e70543ab8edd38eaba315b7e/users/f6b4015e407547fd8886923d5a7d1b64/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:12.729198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.729576 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.729931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.742578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1358/2727] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:57:12.753764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.755474 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.763161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] MFA Rules not processed for user `f6b4015e407547fd8886923d5a7d1b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:12.764510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.832812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06497926-b57d-4f55-a2de-30f2feb62ded None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.852686 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1370/2728] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:57:12.866347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:12.868060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.891838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.892591 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.892965 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.893324 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.954318 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06db6e-97f9-4244-a013-3a6a40bc8fc3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:12.954834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:12.956370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:12.958131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:12.958783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:12.959069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:12.959347 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:12.961169 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:12.966056 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1359/2729] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:57:13.020436 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:13.021819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:13.033779 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1371/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:57:14.532702 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:14.534294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:14.546568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78866dd-d797-4c1e-9c5f-f6e46366b74b service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:14.550167 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:14.550815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:14.551099 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:14.551386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:14.610707 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:14.612141 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:14.621095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1360/2731] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:15.160189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:15.168767 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288bdad-f40a-4353-8459-1fea7abbf1d0 service cinder] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:15.172835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:15.173499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:15.173787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:15.174069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:15.184395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:15.185887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fd16c-15cb-4dae-9adf-d07bdb77a6b7 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:15.195817 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1372/2732] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:57:19.089037 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:19.149196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89249c-fafa-4e96-a001-4984c0a9b539 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:19.153735 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:19.154587 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:19.154869 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:19.155229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] PATH_INFO: `/v3/users/c770605519644d2cb4e7aa68ca04a2ac` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:19.156374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c770605519644d2cb4e7aa68ca04a2ac)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:19.158282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:19.204820 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c770605519644d2cb4e7aa68ca04a2ac'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.214001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c770605519644d2cb4e7aa68ca04a2ac'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.225759 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c770605519644d2cb4e7aa68ca04a2ac'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.226432 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c770605519644d2cb4e7aa68ca04a2ac'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.227033 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c770605519644d2cb4e7aa68ca04a2ac'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.238655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1361/2733] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:19 2022] DELETE /identity/v3/users/c770605519644d2cb4e7aa68ca04a2ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:19.243267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:19.243761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:19.243861 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:19.261495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:57:19.263304 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:19.323137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1373/2734] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:57:19.333819 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:19.335276 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:19.395904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdc35-6b20-4fe5-9414-2ce54678045e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:19.400083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:19.400815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:19.401092 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:19.401378 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:19.411632 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:19.413083 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:19.423359 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1362/2735] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:19.697291 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:19.698822 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:19.712615 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922ff6-5fa6-4685-ad7c-7d8fad2e86b1 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:19.717958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:19.719017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:19.719564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:19.719915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] PATH_INFO: `/v3/projects/f86b8892e7d9409d8846ff058304ee8d` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:19.721399 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86b8892e7d9409d8846ff058304ee8d)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:19.723715 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:19.772734 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86b8892e7d9409d8846ff058304ee8d', 'request_id': 'req-4fc26c02-896c-4c47-bf85-00f4d60cc613'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.782168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86b8892e7d9409d8846ff058304ee8d', 'request_id': 'req-4fc26c02-896c-4c47-bf85-00f4d60cc613'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.789028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86b8892e7d9409d8846ff058304ee8d', 'request_id': 'req-4fc26c02-896c-4c47-bf85-00f4d60cc613'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.800299 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] The token cache is being invalidate because project f86b8892e7d9409d8846ff058304ee8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:19.800606 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.801316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.802963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1374/2736] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:19 2022] DELETE /identity/v3/projects/f86b8892e7d9409d8846ff058304ee8d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:19.807257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:19.817912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b763d38-0b1c-427c-bf20-5ad24828fef3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:19.881126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:19.882136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:19.882326 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:19.882608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] PATH_INFO: `/v3/users/018777011f604280ad5c3d376c0cb64c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:19.883835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018777011f604280ad5c3d376c0cb64c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:19.885761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:19.941016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018777011f604280ad5c3d376c0cb64c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.949422 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018777011f604280ad5c3d376c0cb64c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.977716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018777011f604280ad5c3d376c0cb64c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.978883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018777011f604280ad5c3d376c0cb64c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:19.979971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018777011f604280ad5c3d376c0cb64c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.002287 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1363/2737] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:19 2022] DELETE /identity/v3/users/018777011f604280ad5c3d376c0cb64c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:20.280981 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:20.282479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:20.297268 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc26c02-896c-4c47-bf85-00f4d60cc613 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:20.361729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:20.362601 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:20.362895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:20.363181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] PATH_INFO: `/v3/projects/344bbefaf7da41049d068cc00b945988` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:20.364413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344bbefaf7da41049d068cc00b945988)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:20.366391 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:20.423474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344bbefaf7da41049d068cc00b945988', 'request_id': 'req-d59a38af-8809-4de7-9446-b1bfd3289274'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.429907 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344bbefaf7da41049d068cc00b945988', 'request_id': 'req-d59a38af-8809-4de7-9446-b1bfd3289274'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.436902 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344bbefaf7da41049d068cc00b945988', 'request_id': 'req-d59a38af-8809-4de7-9446-b1bfd3289274'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.446904 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] The token cache is being invalidate because project 344bbefaf7da41049d068cc00b945988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:20.447193 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.447880 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.449415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1375/2738] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:20 2022] DELETE /identity/v3/projects/344bbefaf7da41049d068cc00b945988 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:20.454022 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:20.455606 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:20.468173 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edda8e-0adc-4bfc-95a2-4e47a5f39e79 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:20.530458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:20.531288 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:20.531608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:20.531890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] PATH_INFO: `/v3/users/f6b4015e407547fd8886923d5a7d1b64` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:20.533382 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b4015e407547fd8886923d5a7d1b64)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:20.535353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:20.587961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b4015e407547fd8886923d5a7d1b64'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.596470 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b4015e407547fd8886923d5a7d1b64'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.609457 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b4015e407547fd8886923d5a7d1b64'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.610107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b4015e407547fd8886923d5a7d1b64'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.610726 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b4015e407547fd8886923d5a7d1b64'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:20.628109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1364/2739] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:57:20 2022] DELETE /identity/v3/users/f6b4015e407547fd8886923d5a7d1b64 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:20.907783 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:20.909215 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:20.925937 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a38af-8809-4de7-9446-b1bfd3289274 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:20.986334 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:20.987254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:20.987732 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:20.988069 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] PATH_INFO: `/v3/projects/6e682186e70543ab8edd38eaba315b7e` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:20.989328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e682186e70543ab8edd38eaba315b7e)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:20.991296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:21.046493 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e682186e70543ab8edd38eaba315b7e', 'request_id': 'req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:21.055204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e682186e70543ab8edd38eaba315b7e', 'request_id': 'req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:21.062413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e682186e70543ab8edd38eaba315b7e', 'request_id': 'req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:21.073716 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] The token cache is being invalidate because project 6e682186e70543ab8edd38eaba315b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:57:21.074252 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:21.076687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:57:21.087507 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1376/2740] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:57:20 2022] DELETE /identity/v3/projects/6e682186e70543ab8edd38eaba315b7e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:57:23.227487 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:23.228995 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:23.307523 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc6dc8-241d-4921-90a1-9aa9ef059b49 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:23.375160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:23.375794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:23.376089 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:23.376374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:23.378230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:23.391025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:23.392716 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:23.403467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1365/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:57:27.257435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:57:27.258939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:27.315553 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e345d-2771-447b-9a80-6f8d4a23ff5d admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:57:27.319455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:57:27.320122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:57:27.320416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:57:27.320701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:57:27.322540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:57:27.388499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:57:27.390496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680541b9-5737-4a71-87a1-310c9c4b54ad service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:57:27.400424 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1377/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:57:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:00.884548 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:00.885944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:00.952186 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82d631-5777-4991-9931-fa5174349cc8 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:00.956933 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:00.957811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:00.958093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:00.958370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] PATH_INFO: `/v3/users/2b565b3cc3f648d0b707856fa32fc6f7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:00.959607 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b565b3cc3f648d0b707856fa32fc6f7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:00.961554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.007491 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b565b3cc3f648d0b707856fa32fc6f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.014277 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b565b3cc3f648d0b707856fa32fc6f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.025392 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b565b3cc3f648d0b707856fa32fc6f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.026042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b565b3cc3f648d0b707856fa32fc6f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.026667 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b565b3cc3f648d0b707856fa32fc6f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.039009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1366/2743] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:58:00 2022] DELETE /identity/v3/users/2b565b3cc3f648d0b707856fa32fc6f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:58:01.043496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.044010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.044127 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.061307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:01.062496 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:01.121114 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1378/2744] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:58:01.130939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.132377 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:01.187694 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eb36b-da1f-429e-8297-11174618b1c5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.191868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.192519 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.192799 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.193079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.202329 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.203817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48e34-371f-454b-82e5-702b379b826c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.214017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1367/2745] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:01.474360 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.476133 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:01.493463 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48896d3-90ae-4cc4-81d1-9e190e54ecc2 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.499226 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.500167 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.500453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.500729 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] PATH_INFO: `/v3/projects/c3d50034a1314d3585785fb8bce4e7f5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.502021 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d50034a1314d3585785fb8bce4e7f5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.504012 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.552673 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d50034a1314d3585785fb8bce4e7f5', 'request_id': 'req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.559675 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d50034a1314d3585785fb8bce4e7f5', 'request_id': 'req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.567137 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d50034a1314d3585785fb8bce4e7f5', 'request_id': 'req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.578562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] The token cache is being invalidate because project c3d50034a1314d3585785fb8bce4e7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:58:01.578851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.580066 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-37ea39be-6aa0-45aa-94fa-6fa65ced6a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:01.581794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1379/2746] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:58:01 2022] DELETE /identity/v3/projects/c3d50034a1314d3585785fb8bce4e7f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:58:01.587094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.587425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.587711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.606281 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:01.607526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:01.671660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1368/2747] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:58:01.679375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.679678 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.679961 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.698867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:01.700103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:01.709272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1380/2748] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:58:01.713498 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.724223 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291969d6-b385-475b-a79f-6ef85f9a772b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.728822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.729480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.729761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.730049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.730767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 17:58:01.731075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.732700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.744891 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1369/2749] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 17:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 17:58:01.749150 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.758416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a48e73-29de-4c7f-858c-11cb5f4d9973 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.763104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.763795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.764087 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.764363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.765064 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.766957 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.792213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1381/2750] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 17:58:01 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 17:58:01.796477 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.806956 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72fa07-164a-4430-923b-7b8f5662a942 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.863963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.864635 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.864923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.865201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.865907 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.867863 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.887192 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1370/2751] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 17:58:01 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 17:58:01.891479 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.902741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431f22a-c410-45eb-b89d-2c6f4802be79 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.908275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.909051 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.909375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.909655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.910397 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.912375 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.922970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1382/2752] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:58:01.928202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.937986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8bbe2-becb-4b8a-9d30-38b9d02e2c97 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.944767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.945563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.945900 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.946291 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.947349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.949403 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3309d5-535f-4209-b337-ad03915c93c4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:01.960384 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1371/2753] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 17:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 17:58:01.964620 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:01.974684 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55c5f8-ec3b-42ed-8baa-6760b1809767 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:01.979305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:01.980218 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:01.980508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:01.980788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] PATH_INFO: `/v3/projects/8648ed6dbbbf4333a0f5484eae3be1c5/users/cb35aa39a7dd4365b7efbf6e821410ed/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:01.996149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8648ed6dbbbf4333a0f5484eae3be1c5, user_id=cb35aa39a7dd4365b7efbf6e821410ed, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:01.998802 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:02.012246 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1383/2754] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 17:58:01 2022] PUT /identity/v3/projects/8648ed6dbbbf4333a0f5484eae3be1c5/users/cb35aa39a7dd4365b7efbf6e821410ed/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:58:02.022811 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.023112 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.023526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.049873 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] MFA Rules not processed for user `cb35aa39a7dd4365b7efbf6e821410ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:02.051119 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:02.113204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1372/2755] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:58:02.124303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:02.126009 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:02.181968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed76c82-be5d-466b-90f0-3b1ae2050597 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:02.185614 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:02.186262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.186551 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.186828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.195642 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:02.197067 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517554ea-e4b4-4fb7-82e6-4c9171814812 service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:02.206075 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1384/2756] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:02.231129 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:02.294398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdddfdc-6d5b-4a98-878f-8ced8ca3ba00 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:02.299786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:02.300654 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.300936 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.301207 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] PATH_INFO: `/v3/users/cb35aa39a7dd4365b7efbf6e821410ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.302454 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb35aa39a7dd4365b7efbf6e821410ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:02.304414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:02.352931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb35aa39a7dd4365b7efbf6e821410ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.359918 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb35aa39a7dd4365b7efbf6e821410ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.371997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb35aa39a7dd4365b7efbf6e821410ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.372708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb35aa39a7dd4365b7efbf6e821410ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.373340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb35aa39a7dd4365b7efbf6e821410ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.385451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1373/2757] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:58:02 2022] DELETE /identity/v3/users/cb35aa39a7dd4365b7efbf6e821410ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:58:02.390197 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.390487 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.390769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.408278 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:02.409495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:02.469527 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1385/2758] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 17:58:02.480015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:02.481411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:02.537682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e8697-ae39-4947-b887-668f766f9c88 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:02.541674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:02.542316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.542602 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.542878 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.553019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:02.554450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:02.565017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1374/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:02.830837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:02.832281 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:02.844413 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffd84b-4e96-4941-8ef9-15357b52b095 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:02.850028 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:02.850934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:02.851227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:02.851537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] PATH_INFO: `/v3/projects/8648ed6dbbbf4333a0f5484eae3be1c5` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:02.852744 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8648ed6dbbbf4333a0f5484eae3be1c5)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:02.854645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:02.902570 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8648ed6dbbbf4333a0f5484eae3be1c5', 'request_id': 'req-a55b2193-4779-414b-87d5-052f6e37984f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.910357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8648ed6dbbbf4333a0f5484eae3be1c5', 'request_id': 'req-a55b2193-4779-414b-87d5-052f6e37984f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.916703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8648ed6dbbbf4333a0f5484eae3be1c5', 'request_id': 'req-a55b2193-4779-414b-87d5-052f6e37984f'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.928082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] The token cache is being invalidate because project 8648ed6dbbbf4333a0f5484eae3be1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:58:02.928377 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.929033 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:58:02.930580 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1386/2760] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:58:02 2022] DELETE /identity/v3/projects/8648ed6dbbbf4333a0f5484eae3be1c5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:58:08.727179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:08.727179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:08.782290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cb7c0-c0e9-44b8-831a-1c472f40b4a8 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:08.831680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:08.832340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:08.832630 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:08.832914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:08.834738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:08.894264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:08.895902 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c23f8-6227-43bd-b46c-679cceeb6b01 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:08.904877 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1375/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:58:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:12.163809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:58:12.165398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:12.257083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2193-4779-414b-87d5-052f6e37984f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:58:12.263330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:58:12.264029 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:12.264400 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:12.264772 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:12.266645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:12.278691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:58:12.280414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:58:12.291567 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1387/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:58:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:58:14.773139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:58:14.773709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:58:14.773709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:58:14.791170 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] MFA Rules not processed for user `6a1dcd8a84cf4f33b5405ad0279bf2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 17:58:14.792414 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:58:14.799916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1376/2763] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 17:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 17:59:33.773430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:33.774878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:33.889303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98181e-ac5d-4fc7-9f66-c4d8cd453b19 service placement] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:33.895280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:33.896209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:33.896482 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:33.896790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:33.900839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:33.912122 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:33.914254 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:33.925611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1388/2764] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:59:33.957700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:33.959722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:34.017795 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73112f10-3519-4a67-843c-c3307c7541ac None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:34.021363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:34.022149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:34.023054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:34.023388 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:34.025312 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:34.040513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:34.041970 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:34.053984 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1377/2765] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:59:43.445647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:43.455149 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dbff1-7dd2-4c4e-ae80-ffc4620aa1e1 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:43.458928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:43.459637 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:43.459922 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:43.460201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:43.462147 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:43.475867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:43.478059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:43.488915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1389/2766] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:59:46.443927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:46.445385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:46.456214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8588-0204-4946-80a1-1bcb1f1be768 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:46.459890 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:46.460544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:46.460849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:46.461125 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:46.462836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:46.522742 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:46.524419 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:46.533945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1378/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 17:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:59:53.046705 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:53.048398 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:53.071978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66b91-3e1c-4122-b134-a6b2cc6c228a service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:53.077848 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:53.079143 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:53.080320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:53.080683 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] PATH_INFO: `/v3/users/798edb753845410fa6f9c136b43abf05` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:53.082079 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=798edb753845410fa6f9c136b43abf05)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:53.088412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:53.152810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798edb753845410fa6f9c136b43abf05'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.153476 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798edb753845410fa6f9c136b43abf05'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.166325 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798edb753845410fa6f9c136b43abf05'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.167083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798edb753845410fa6f9c136b43abf05'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.175789 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798edb753845410fa6f9c136b43abf05'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.189108 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1390/2768] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:59:53 2022] DELETE /identity/v3/users/798edb753845410fa6f9c136b43abf05 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:59:53.404204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:53.420561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cde428-5d1c-4bdd-83e4-762d250b9fdc service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:53.478530 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:53.479420 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:53.479712 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:53.479998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] PATH_INFO: `/v3/projects/c93f0e69798e491aba3c8cf1493c2733` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:53.481208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93f0e69798e491aba3c8cf1493c2733)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:53.483163 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:53.531093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93f0e69798e491aba3c8cf1493c2733', 'request_id': 'req-17ffdfd7-3014-4e12-b700-97ec11dfa137'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.537436 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93f0e69798e491aba3c8cf1493c2733', 'request_id': 'req-17ffdfd7-3014-4e12-b700-97ec11dfa137'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.544880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93f0e69798e491aba3c8cf1493c2733', 'request_id': 'req-17ffdfd7-3014-4e12-b700-97ec11dfa137'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.556719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] The token cache is being invalidate because project c93f0e69798e491aba3c8cf1493c2733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:59:53.557004 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.557661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.559302 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1379/2769] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:59:53 2022] DELETE /identity/v3/projects/c93f0e69798e491aba3c8cf1493c2733 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:59:53.563168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:53.564589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:53.578293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf98c5-646c-4ab7-90d0-d5304b1df0df admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:53.633927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:53.634812 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:53.635093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:53.635389 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] PATH_INFO: `/v3/users/2ae9850c094842ae8a899d08a48b3b91` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:53.636591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae9850c094842ae8a899d08a48b3b91)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:53.638539 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:53.687647 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae9850c094842ae8a899d08a48b3b91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.688305 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae9850c094842ae8a899d08a48b3b91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.700537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae9850c094842ae8a899d08a48b3b91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.701184 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae9850c094842ae8a899d08a48b3b91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.708438 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae9850c094842ae8a899d08a48b3b91'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:53.720394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1391/2770] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 17:59:53 2022] DELETE /identity/v3/users/2ae9850c094842ae8a899d08a48b3b91 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:59:53.896867 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:59:53.898629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:59:53.918489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffdfd7-3014-4e12-b700-97ec11dfa137 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:59:53.977998 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:59:53.978868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:59:53.979159 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:59:53.979481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] PATH_INFO: `/v3/projects/ddd02c052d5f458e8f2cb70d605f2101` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:59:53.980812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd02c052d5f458e8f2cb70d605f2101)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:59:53.982770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:59:54.029215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd02c052d5f458e8f2cb70d605f2101', 'request_id': 'req-24aa91ae-8bfb-4353-bfb8-0014f8875099'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:54.035148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd02c052d5f458e8f2cb70d605f2101', 'request_id': 'req-24aa91ae-8bfb-4353-bfb8-0014f8875099'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:54.043014 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd02c052d5f458e8f2cb70d605f2101', 'request_id': 'req-24aa91ae-8bfb-4353-bfb8-0014f8875099'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:54.052979 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] The token cache is being invalidate because project ddd02c052d5f458e8f2cb70d605f2101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:59:54.053266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:54.053899 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:59:54.056048 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1380/2771] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 17:59:53 2022] DELETE /identity/v3/projects/ddd02c052d5f458e8f2cb70d605f2101 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:12.880916 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:12.882306 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:12.940631 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b0aba-c176-45e7-a2cd-14b8ee54f8ee admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:12.993544 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:12.994210 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:12.994500 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:12.994784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:12.997405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:13.061896 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:13.063276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:13.073955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1392/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:00:16.221676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.223286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:16.237363 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa91ae-8bfb-4353-bfb8-0014f8875099 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.242161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.243181 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.243335 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.243731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] PATH_INFO: `/v3/users/6a1dcd8a84cf4f33b5405ad0279bf2b4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.245616 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1dcd8a84cf4f33b5405ad0279bf2b4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.247672 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.297911 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1dcd8a84cf4f33b5405ad0279bf2b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.305783 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1dcd8a84cf4f33b5405ad0279bf2b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.319398 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1dcd8a84cf4f33b5405ad0279bf2b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.320136 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1dcd8a84cf4f33b5405ad0279bf2b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.320756 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4949c63e-99ea-4dd3-b1b1-16d31391881e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1dcd8a84cf4f33b5405ad0279bf2b4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.333290 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1381/2773] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:16 2022] DELETE /identity/v3/users/6a1dcd8a84cf4f33b5405ad0279bf2b4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:16.507093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.518262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae430d-dee3-4f70-9713-bd15a4bca548 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.577074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.578188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.578403 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.578688 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] PATH_INFO: `/v3/projects/a83ced38e3ea471399fe49b3162b38e7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.579917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83ced38e3ea471399fe49b3162b38e7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.581845 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.627356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83ced38e3ea471399fe49b3162b38e7', 'request_id': 'req-da693041-940f-47a9-9f68-8e984e9070f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.634440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83ced38e3ea471399fe49b3162b38e7', 'request_id': 'req-da693041-940f-47a9-9f68-8e984e9070f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.640927 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83ced38e3ea471399fe49b3162b38e7', 'request_id': 'req-da693041-940f-47a9-9f68-8e984e9070f5'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.650618 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] The token cache is being invalidate because project a83ced38e3ea471399fe49b3162b38e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:00:16.651455 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.652301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-da693041-940f-47a9-9f68-8e984e9070f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:16.653838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1393/2774] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:00:16 2022] DELETE /identity/v3/projects/a83ced38e3ea471399fe49b3162b38e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:16.658761 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.659057 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.659338 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.677169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:16.678370 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:16.736386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1382/2775] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:16.744280 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.744577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.745027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.763676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:16.764956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:16.772888 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1394/2776] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:16.777631 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.787971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853823c-bef1-4bb2-b758-0429975a7d01 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.792972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.793747 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.794135 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.794511 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.795353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:00:16.795802 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.797624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.809683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1383/2777] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:00:16.814035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.824175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343e93-4f6d-4b79-af71-fc7944a1366e None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.829123 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.829776 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.830061 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.830335 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.831041 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.833008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.858216 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1395/2778] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:16 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:16.862085 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.871944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638fb1-33b3-44b1-8e5e-8837e4aa80d3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.926484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.927161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.927510 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.927793 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.928500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.930426 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.950253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1384/2779] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:16 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:16.954564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.965453 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0317-7bd5-4e75-a888-f017aaf91b3b admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:16.970192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:16.970849 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:16.971139 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:16.971452 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:16.972183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:16.973755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:16.983827 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1396/2780] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:16.987737 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:16.997641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb09a-91c2-4e34-80ab-9f23452b53ac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:17.002204 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:17.002860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.003153 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.003467 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.004202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:17.005828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51e8a1-f865-4a7f-815c-94100b80af19 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:17.015981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1385/2781] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:17.019944 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:17.030958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289c0ce-b97d-4b37-bb51-ed1c2dcb92ea admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:17.036616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:17.037701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.037939 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.038261 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] PATH_INFO: `/v3/projects/5ec050d30f2b488fb90cb168c9acd267/users/b2b3ea7ece664fd8b5b2ca5a542b4d35/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.054109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec050d30f2b488fb90cb168c9acd267, user_id=b2b3ea7ece664fd8b5b2ca5a542b4d35, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:17.056819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:17.069955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1397/2782] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:17 2022] PUT /identity/v3/projects/5ec050d30f2b488fb90cb168c9acd267/users/b2b3ea7ece664fd8b5b2ca5a542b4d35/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:00:17.075682 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063256-b4a6-4ae1-846c-c0302ba515ce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.075980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063256-b4a6-4ae1-846c-c0302ba515ce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.076264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf063256-b4a6-4ae1-846c-c0302ba515ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.096304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bf063256-b4a6-4ae1-846c-c0302ba515ce None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:17.097516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bf063256-b4a6-4ae1-846c-c0302ba515ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:17.155788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1386/2783] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:00:17.165450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:17.167188 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:17.223170 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0fb05-bbfd-4c03-b91d-581358425b80 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:17.226781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:17.227462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.227749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.228027 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.236757 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:17.238236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:17.247886 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1398/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:00:17.860144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.860681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.860782 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.888824 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] MFA Rules not processed for user `b2b3ea7ece664fd8b5b2ca5a542b4d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:17.890063 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:17.954777 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1387/2785] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:17.959204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:17.970384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a181-c527-44a4-a113-a95e856fd9f0 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:17.975224 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:17.976013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:17.976368 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:17.976652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:17.977348 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:17.979867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.007308 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1399/2786] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:17 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:18.011566 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:18.022743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335af90-2d3a-4047-aa30-4972d9c63c08 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:18.078450 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:18.079042 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.079331 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.079636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.080339 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:18.082284 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.102627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1388/2787] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:18 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:18.107532 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:18.117777 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46773b0-cc97-4ef4-bfb3-15418d642917 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:18.122636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:18.123181 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.123503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.123786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.124508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:18.126093 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.136352 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1400/2788] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:18.140829 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:18.151787 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b149-ded3-4359-80b3-99a434e6e38d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:18.157032 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:18.157945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.158233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.158515 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] PATH_INFO: `/v3/projects/e5174c31e2364bf99943f6f5909e7ec7/users/5403afac7ec7434990082403e7555510/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.174314 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5174c31e2364bf99943f6f5909e7ec7, user_id=5403afac7ec7434990082403e7555510, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:18.177016 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.190196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1389/2789] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:18 2022] PUT /identity/v3/projects/e5174c31e2364bf99943f6f5909e7ec7/users/5403afac7ec7434990082403e7555510/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:18.194349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:18.205152 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70979393-8e82-42ec-af69-c72af3f6b897 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:18.259670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:18.260416 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.260809 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.261091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.261826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:18.263447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50791f24-daa2-4694-8368-9108890bde29 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.273120 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1401/2790] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:18.277714 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:18.287905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba28819-06a2-49c5-9440-57d31ab91e74 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:18.293096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:18.293971 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.294258 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.294562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] PATH_INFO: `/v3/projects/e5174c31e2364bf99943f6f5909e7ec7/users/5403afac7ec7434990082403e7555510/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.296551 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5174c31e2364bf99943f6f5909e7ec7, user_id=5403afac7ec7434990082403e7555510, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:18.299240 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:18.309972 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1390/2791] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:18 2022] PUT /identity/v3/projects/e5174c31e2364bf99943f6f5909e7ec7/users/5403afac7ec7434990082403e7555510/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:18.925310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:18.925608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:18.925894 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:18.953711 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] MFA Rules not processed for user `5403afac7ec7434990082403e7555510`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:18.954934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:19.022430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1402/2792] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:20.009430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:20.071332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6a06e-2b5a-48ac-9d63-e31b06ae3f14 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:20.076540 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:20.077666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:20.077954 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:20.078229 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] PATH_INFO: `/v3/users/b2b3ea7ece664fd8b5b2ca5a542b4d35` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:20.079557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b3ea7ece664fd8b5b2ca5a542b4d35)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:20.081488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:20.126226 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b3ea7ece664fd8b5b2ca5a542b4d35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.134058 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b3ea7ece664fd8b5b2ca5a542b4d35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.146199 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b3ea7ece664fd8b5b2ca5a542b4d35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.146879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b3ea7ece664fd8b5b2ca5a542b4d35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.147582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b3ea7ece664fd8b5b2ca5a542b4d35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.159542 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1391/2793] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:20 2022] DELETE /identity/v3/users/b2b3ea7ece664fd8b5b2ca5a542b4d35 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:20.326826 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:20.340034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877610e-a955-44f6-8db9-3533f4de49d5 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:20.396805 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:20.397728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:20.397956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:20.398232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] PATH_INFO: `/v3/projects/5ec050d30f2b488fb90cb168c9acd267` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:20.399450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec050d30f2b488fb90cb168c9acd267)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:20.402010 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:20.445406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec050d30f2b488fb90cb168c9acd267', 'request_id': 'req-c6728586-dedb-4636-b261-5b2ea5c51828'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.452670 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec050d30f2b488fb90cb168c9acd267', 'request_id': 'req-c6728586-dedb-4636-b261-5b2ea5c51828'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.458626 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec050d30f2b488fb90cb168c9acd267', 'request_id': 'req-c6728586-dedb-4636-b261-5b2ea5c51828'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.469024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] The token cache is being invalidate because project 5ec050d30f2b488fb90cb168c9acd267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:00:20.469307 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.469933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.471483 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1403/2794] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:00:20 2022] DELETE /identity/v3/projects/5ec050d30f2b488fb90cb168c9acd267 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:20.475512 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:20.476915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:20.490367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffce34-3765-4770-8eff-bcc88851164e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:20.545554 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:20.546433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:20.546724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:20.547010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] PATH_INFO: `/v3/users/5403afac7ec7434990082403e7555510` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:20.548260 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5403afac7ec7434990082403e7555510)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:20.550215 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:20.594578 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5403afac7ec7434990082403e7555510'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.601758 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5403afac7ec7434990082403e7555510'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.615286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5403afac7ec7434990082403e7555510'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.616045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5403afac7ec7434990082403e7555510'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.616708 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cafcffe4-48d6-4afe-a667-7db18884efc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5403afac7ec7434990082403e7555510'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.629418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1392/2795] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:20 2022] DELETE /identity/v3/users/5403afac7ec7434990082403e7555510 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:20.799708 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:20.801135 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:20.816059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6728586-dedb-4636-b261-5b2ea5c51828 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:20.875819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:20.876691 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:20.876978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:20.877257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] PATH_INFO: `/v3/projects/e5174c31e2364bf99943f6f5909e7ec7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:20.878489 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5174c31e2364bf99943f6f5909e7ec7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:20.880485 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:20.924059 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5174c31e2364bf99943f6f5909e7ec7', 'request_id': 'req-20fe059c-0586-4057-aa20-6401f49d9380'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.931234 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5174c31e2364bf99943f6f5909e7ec7', 'request_id': 'req-20fe059c-0586-4057-aa20-6401f49d9380'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.939694 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5174c31e2364bf99943f6f5909e7ec7', 'request_id': 'req-20fe059c-0586-4057-aa20-6401f49d9380'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.950699 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] The token cache is being invalidate because project e5174c31e2364bf99943f6f5909e7ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:00:20.950988 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.951690 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-20fe059c-0586-4057-aa20-6401f49d9380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:20.953528 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1404/2796] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:00:20 2022] DELETE /identity/v3/projects/e5174c31e2364bf99943f6f5909e7ec7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:20.958543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:20.958835 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:20.959161 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:20.976349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:20.977557 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:21.034858 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1393/2797] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:21.042664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.042984 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.043232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.061724 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:21.062923 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:21.070813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1405/2798] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:21.075990 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.085912 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2874c-a114-46a8-8ca6-3fbce87e42ff None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.090601 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.091259 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.091652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.091941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.092711 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:00:21.093026 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.094629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.105904 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1394/2799] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:00:21.110159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.119286 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d3520-ca77-4e51-b1de-68dbc8fb7a5f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.124557 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.125206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.125519 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.125797 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.126503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.128423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.156837 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1406/2800] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:21.158443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.168645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c87dab-ccd7-4a3b-bd21-d52d87540711 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.223131 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.223770 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.224055 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.224332 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.225027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.226946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.250914 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1395/2801] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:21.252301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.262646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee3e0-c6de-4e8f-8265-2fb966105f6e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.267321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.268022 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.268310 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.268591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.269321 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.270911 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.281117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1407/2802] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:00:21.285030 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.295559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b482b6-b43c-4969-86c2-b960894ffaaf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.300093 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.300749 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.301038 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.301318 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.302044 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.303665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad0f7-4076-4ba1-bd30-3e57818d2b41 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.314010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1396/2803] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:21.318103 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.328641 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd745b7d-7908-4149-9c67-4938f4865a95 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.333356 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.334245 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.334530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.334831 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] PATH_INFO: `/v3/projects/11f095bc108e4a3f9a109a10546282bf/users/cd6f8eeeb88141028b5d27d852fb4806/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.350478 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f095bc108e4a3f9a109a10546282bf, user_id=cd6f8eeeb88141028b5d27d852fb4806, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.353657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.367586 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1408/2804] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:21 2022] PUT /identity/v3/projects/11f095bc108e4a3f9a109a10546282bf/users/cd6f8eeeb88141028b5d27d852fb4806/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:21.380132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.380458 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.380743 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.408705 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] MFA Rules not processed for user `cd6f8eeeb88141028b5d27d852fb4806`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:21.409927 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:21.474126 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1397/2805] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:00:21.478481 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.541517 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d10ec-024a-4c8d-aa4a-f491ec8da01a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.546808 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.547503 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.547798 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.548082 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.548794 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.550702 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.577018 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1409/2806] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:21.581282 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.592478 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2329e-e0ed-4b55-b870-13e925370cba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.648947 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.649617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.649898 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.650179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.650882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.652963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.671834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1398/2807] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:00:21.676094 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.688232 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b75d9-a2d0-4312-9234-2c5a8b6f3fd1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.693192 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.693865 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.694157 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.694440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.695175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.696819 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.709024 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1410/2808] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:21.713433 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.723596 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a656a-6186-40fb-b8f1-1376a6422745 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.728544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.729754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.729754 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.730294 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] PATH_INFO: `/v3/projects/bb2ce69fd588402e9e5271ea02274afa/users/ca702a7b2acd48358d9f839f66557a47/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.744629 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2ce69fd588402e9e5271ea02274afa, user_id=ca702a7b2acd48358d9f839f66557a47, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.748095 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.761368 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1399/2809] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:21 2022] PUT /identity/v3/projects/bb2ce69fd588402e9e5271ea02274afa/users/ca702a7b2acd48358d9f839f66557a47/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:21.765379 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.775680 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70002-4bce-4be3-a0bd-5528d854ce90 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.834881 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.835714 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.835928 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.836209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.836951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.838555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081a683-7a9c-4807-a892-392f76419f1d admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.849456 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1411/2810] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:21.853765 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:21.864237 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75019a2-d42a-4dda-bb70-916bc3ae570f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:21.868871 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:21.869745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.870559 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.870946 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] PATH_INFO: `/v3/projects/bb2ce69fd588402e9e5271ea02274afa/users/ca702a7b2acd48358d9f839f66557a47/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.872997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2ce69fd588402e9e5271ea02274afa, user_id=ca702a7b2acd48358d9f839f66557a47, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:21.875665 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:21.886452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1400/2811] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:21 2022] PUT /identity/v3/projects/bb2ce69fd588402e9e5271ea02274afa/users/ca702a7b2acd48358d9f839f66557a47/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:21.896322 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394be04-a260-4b2d-892f-07704748f767 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:21.896784 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394be04-a260-4b2d-892f-07704748f767 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:21.897078 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394be04-a260-4b2d-892f-07704748f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:21.922898 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b394be04-a260-4b2d-892f-07704748f767 None None] MFA Rules not processed for user `ca702a7b2acd48358d9f839f66557a47`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:21.924201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b394be04-a260-4b2d-892f-07704748f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:21.992151 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1412/2812] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:00:22.003481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:22.005230 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:22.062034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089c3b-5ba8-486b-8b7a-1466796fc7d5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:22.065957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:22.066647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:22.066935 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:22.067212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:22.121885 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:22.123343 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:22.132132 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1401/2813] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:00:27.739946 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394be04-a260-4b2d-892f-07704748f767 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:27.741343 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b394be04-a260-4b2d-892f-07704748f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:27.753919 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394be04-a260-4b2d-892f-07704748f767 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:27.757584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:27.758231 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:27.758523 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:27.758801 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:27.768292 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:27.769721 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c970a-c4f9-4d1d-98f4-f644f8df6c6f service cinder] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:27.779095 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1413/2814] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:00:56.575064 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:56.642257 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3118bb2-3cbe-44b0-8f18-e049552628a7 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:56.646943 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:56.647847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:56.648139 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:56.648428 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] PATH_INFO: `/v3/users/cd6f8eeeb88141028b5d27d852fb4806` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:56.649658 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6f8eeeb88141028b5d27d852fb4806)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:56.651651 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:56.700012 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6f8eeeb88141028b5d27d852fb4806'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:56.708248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6f8eeeb88141028b5d27d852fb4806'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:56.719532 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6f8eeeb88141028b5d27d852fb4806'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:56.720196 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6f8eeeb88141028b5d27d852fb4806'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:56.720812 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6f8eeeb88141028b5d27d852fb4806'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:56.732424 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1402/2815] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:56 2022] DELETE /identity/v3/users/cd6f8eeeb88141028b5d27d852fb4806 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:56.737474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:56.738023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:56.738023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:56.755929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:56.757161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:56.815998 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1414/2816] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:56.825425 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:56.827473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:56.883627 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6672-e849-4b87-8b19-ef5a7c27a721 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:56.887249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:56.887925 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:56.888214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:56.888488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:56.897475 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:56.898908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:56.908652 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1403/2817] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:00:57.165769 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:57.167220 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:57.179161 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858fad-47c8-47b7-8130-94afee9b4dea None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:57.183839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:57.184737 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.185025 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.189934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] PATH_INFO: `/v3/projects/11f095bc108e4a3f9a109a10546282bf` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.191238 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f095bc108e4a3f9a109a10546282bf)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:57.193211 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:57.240839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f095bc108e4a3f9a109a10546282bf', 'request_id': 'req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.248008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f095bc108e4a3f9a109a10546282bf', 'request_id': 'req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.254761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f095bc108e4a3f9a109a10546282bf', 'request_id': 'req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.265323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] The token cache is being invalidate because project 11f095bc108e4a3f9a109a10546282bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:00:57.265611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.266262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.267828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1415/2818] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:00:57 2022] DELETE /identity/v3/projects/11f095bc108e4a3f9a109a10546282bf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:57.271757 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:57.282208 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030ddc-0434-4982-b96f-b55232feef49 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:57.339076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:57.340043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.340362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.340645 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] PATH_INFO: `/v3/users/ca702a7b2acd48358d9f839f66557a47` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.341851 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca702a7b2acd48358d9f839f66557a47)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:57.344563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:57.388502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca702a7b2acd48358d9f839f66557a47'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.396316 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca702a7b2acd48358d9f839f66557a47'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.408360 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca702a7b2acd48358d9f839f66557a47'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.409081 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca702a7b2acd48358d9f839f66557a47'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.409748 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66ce30e9-f67f-4d72-9932-22af56269a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca702a7b2acd48358d9f839f66557a47'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.421464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1404/2819] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:57 2022] DELETE /identity/v3/users/ca702a7b2acd48358d9f839f66557a47 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:57.689086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:57.690594 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:57.704086 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3757b4c-5a0c-4a0a-8a36-f42c7f3f98de admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:57.761076 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:57.761890 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.762175 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.762450 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] PATH_INFO: `/v3/projects/bb2ce69fd588402e9e5271ea02274afa` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.763674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2ce69fd588402e9e5271ea02274afa)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:57.765598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:57.810584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2ce69fd588402e9e5271ea02274afa', 'request_id': 'req-030b1222-97e3-4c13-bc84-0619967598bb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.818489 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2ce69fd588402e9e5271ea02274afa', 'request_id': 'req-030b1222-97e3-4c13-bc84-0619967598bb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.824878 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2ce69fd588402e9e5271ea02274afa', 'request_id': 'req-030b1222-97e3-4c13-bc84-0619967598bb'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.839790 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] The token cache is being invalidate because project bb2ce69fd588402e9e5271ea02274afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80255) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:00:57.840128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.840810 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-030b1222-97e3-4c13-bc84-0619967598bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:57.843191 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1416/2820] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:00:57 2022] DELETE /identity/v3/projects/bb2ce69fd588402e9e5271ea02274afa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:57.848263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.848729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.848832 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.867429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:57.868577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:57.926876 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1405/2821] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:57.936423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.936730 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.937017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.956851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:57.958080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:57.966212 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1417/2822] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:57.972442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:57.982227 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad14e-3c6f-4580-8be1-4be8892597a0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:57.987145 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:57.987931 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:57.988217 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:57.988500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:57.989251 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:00:57.989562 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:57.991188 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.002921 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1406/2823] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:00:58.007385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.017466 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dc17c-ccc3-4a9f-873f-4b38f402b9a8 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.022380 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.023032 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.023320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.023644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.024339 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.026257 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.060930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1418/2824] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:58.065175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.075001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4d0b-fefc-4cb3-b29f-8d7bb267bee5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.130049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.130677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.130968 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.131253 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.132027 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.133993 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.153179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1407/2825] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:58.157662 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.167835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335392f8-8c8c-47df-9c0a-9f5cd7e5cec6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.173337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.173996 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.174283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.174559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.175293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.176920 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.187394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1419/2826] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:58.191254 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.201180 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12c642-2454-4a48-86a7-d783290af2c9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.206345 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.207015 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.207304 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.207617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.208353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.209945 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32185503-e837-4f5f-964c-65c9b23c4634 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.220611 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1408/2827] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:58.224736 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.235020 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe3ae-58e1-44c1-a189-d5a9935c76c8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.239870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.240753 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.241035 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.241311 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] PATH_INFO: `/v3/projects/66884652145e4470a45c9acfdc80ad74/users/8083d6d1dc0e49a399c24ce51b2b316a/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.256237 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66884652145e4470a45c9acfdc80ad74, user_id=8083d6d1dc0e49a399c24ce51b2b316a, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.258879 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.271871 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1420/2828] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:58 2022] PUT /identity/v3/projects/66884652145e4470a45c9acfdc80ad74/users/8083d6d1dc0e49a399c24ce51b2b316a/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:00:58.282691 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.282986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.283292 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.310544 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] MFA Rules not processed for user `8083d6d1dc0e49a399c24ce51b2b316a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:58.311884 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:58.375738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1409/2829] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:58.380228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.443636 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74a80f-3129-49f0-ac2a-954fee0469e8 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.448355 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.449017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.449303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.449582 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] PATH_INFO: `/v3/projects` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.450276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.452214 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.477251 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1421/2830] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:58.481336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.494333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9a0a4-0766-4fe9-b91c-eee461d99492 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.551267 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.551961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.552248 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.552527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.553214 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.555133 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.574605 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1410/2831] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:00:58.578583 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.589019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dbc9d-df24-4249-a3f0-2ff15fec955a admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.594361 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.595017 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.595301 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.595653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.596477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.598060 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.608945 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1422/2832] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:58.613189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.624111 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485e249-7839-40ae-9f65-68658a6eaf47 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.629978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.630939 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.631193 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.631506 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] PATH_INFO: `/v3/projects/70fa830e1a8d4586a244f1775b1b4971/users/a5b1854f7e964728b6d33627405ab53a/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.646951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa830e1a8d4586a244f1775b1b4971, user_id=a5b1854f7e964728b6d33627405ab53a, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.649722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.662752 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1411/2833] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:58 2022] PUT /identity/v3/projects/70fa830e1a8d4586a244f1775b1b4971/users/a5b1854f7e964728b6d33627405ab53a/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:58.666741 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.676781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b5635-ee93-4de4-8c91-5c4e97637edf admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.732091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.732924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.733283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.733562 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.734295 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.735955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e9172-cb7b-4c5d-bf1d-65b34a95aeff admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.746109 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1423/2834] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:00:58.750518 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.760683 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b155a-c8a6-4e12-b60e-578e0a3bab00 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.766189 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.767069 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.767358 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.767663 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] PATH_INFO: `/v3/projects/70fa830e1a8d4586a244f1775b1b4971/users/a5b1854f7e964728b6d33627405ab53a/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.769656 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa830e1a8d4586a244f1775b1b4971, user_id=a5b1854f7e964728b6d33627405ab53a, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.772367 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.783915 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1412/2835] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:00:58 2022] PUT /identity/v3/projects/70fa830e1a8d4586a244f1775b1b4971/users/a5b1854f7e964728b6d33627405ab53a/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:58.795274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.795830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.795966 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.822447 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] MFA Rules not processed for user `a5b1854f7e964728b6d33627405ab53a`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:58.823682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:58.890653 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1424/2836] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:58.901134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:58.902897 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:58.959010 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4869c0-9e3e-4d7d-af9a-7809ab16ff80 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:58.962731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:58.963386 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:58.963698 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:58.963982 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:58.973577 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:58.975017 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885aed7-199f-4225-b742-959047656d5d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:58.984481 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1413/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:00:59.502409 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:59.564349 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10bd5e-7355-4954-a99e-a2917d28123f None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:59.568912 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:59.569782 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:59.570071 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:59.570350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] PATH_INFO: `/v3/users/8083d6d1dc0e49a399c24ce51b2b316a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:59.571577 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8083d6d1dc0e49a399c24ce51b2b316a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:59.573508 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:59.621395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8083d6d1dc0e49a399c24ce51b2b316a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:59.622049 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8083d6d1dc0e49a399c24ce51b2b316a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:59.633230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8083d6d1dc0e49a399c24ce51b2b316a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:59.633869 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8083d6d1dc0e49a399c24ce51b2b316a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:59.641346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8083d6d1dc0e49a399c24ce51b2b316a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:00:59.653213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1425/2838] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:00:59 2022] DELETE /identity/v3/users/8083d6d1dc0e49a399c24ce51b2b316a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:00:59.658233 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:59.658531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:59.658815 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:59.676194 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:00:59.677418 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:59.735676 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1414/2839] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:00:59.745289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:00:59.746698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:00:59.802833 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee471f-70ea-464e-9a0a-fe0cf7279c62 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:00:59.806545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:00:59.807227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:00:59.807545 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:00:59.807828 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:00:59.817887 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:00:59.819341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:00:59.829598 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1426/2840] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:00.099322 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:00.100846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:00.113836 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff72ff-27cd-4275-929b-1a1044e11aaa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:00.118561 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:00.119451 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.120175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.120175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] PATH_INFO: `/v3/projects/66884652145e4470a45c9acfdc80ad74` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.121205 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66884652145e4470a45c9acfdc80ad74)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:00.123137 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:00.170670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66884652145e4470a45c9acfdc80ad74', 'request_id': 'req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.177268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66884652145e4470a45c9acfdc80ad74', 'request_id': 'req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.185685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66884652145e4470a45c9acfdc80ad74', 'request_id': 'req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.199687 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] The token cache is being invalidate because project 66884652145e4470a45c9acfdc80ad74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:01:00.199981 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.200642 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.202340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1415/2841] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:01:00 2022] DELETE /identity/v3/projects/66884652145e4470a45c9acfdc80ad74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:00.206665 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:00.216350 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff46f5-df9b-4f97-9989-b5f85ecc8905 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:00.279385 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:00.280296 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.280584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.280895 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] PATH_INFO: `/v3/users/a5b1854f7e964728b6d33627405ab53a` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.282244 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b1854f7e964728b6d33627405ab53a)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:00.284499 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:00.339446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b1854f7e964728b6d33627405ab53a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.340371 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b1854f7e964728b6d33627405ab53a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.352233 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b1854f7e964728b6d33627405ab53a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.352943 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b1854f7e964728b6d33627405ab53a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.361221 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-99ea844b-2b26-4ad6-959d-dcf399b602f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b1854f7e964728b6d33627405ab53a'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.375648 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1427/2842] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:01:00 2022] DELETE /identity/v3/users/a5b1854f7e964728b6d33627405ab53a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:00.661513 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:00.663049 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:00.677810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525f2e-5c50-48bd-a9e5-a99ecf496e69 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:00.751134 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:00.751961 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.752249 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.752531 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] PATH_INFO: `/v3/projects/70fa830e1a8d4586a244f1775b1b4971` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.754855 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fa830e1a8d4586a244f1775b1b4971)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:00.756830 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:00.808951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fa830e1a8d4586a244f1775b1b4971', 'request_id': 'req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.817951 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fa830e1a8d4586a244f1775b1b4971', 'request_id': 'req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.825986 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fa830e1a8d4586a244f1775b1b4971', 'request_id': 'req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.838762 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] The token cache is being invalidate because project 70fa830e1a8d4586a244f1775b1b4971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:01:00.838896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.839609 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cc85f7c2-6ffd-48c3-a7fa-e44ef8c68aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:00.841701 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1416/2843] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:01:00 2022] DELETE /identity/v3/projects/70fa830e1a8d4586a244f1775b1b4971 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:00.848116 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.848625 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.848749 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.867687 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:00.868915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:00.926991 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1428/2844] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:00.934773 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.935065 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.935959 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.957980 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:00.959202 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:00.967822 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1417/2845] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:00.972303 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:00.982030 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c8df9-5d33-4815-9a35-85ba5d8473d7 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:00.986864 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:00.987571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:00.987862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:00.988145 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:00.988950 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:01:00.989262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:00.990862 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.002591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1429/2846] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 18:01:01.006875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.016868 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028edf55-29b9-47ee-9eb7-8d34b64bb1b2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.021666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.022323 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.022641 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.022923 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.023670 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.025624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.050800 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1418/2847] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:01:01 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:01.054955 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.065786 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b7c8-88fd-42f7-8e31-0b316ef51275 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.122477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.123316 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.123725 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.124131 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.124970 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.126891 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.147859 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1430/2848] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:01:01 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:01.151978 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.163264 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfd77-3cba-42b2-bbc1-99fe45d2f495 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.168794 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.169570 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.169952 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.170333 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.171435 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.173149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.183792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1419/2849] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:01.188474 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.198414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a815-a578-4b69-9b78-13ad8bf9695e admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.203975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.204635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.204924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.205206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.205963 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.207591 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50874-c337-4180-ba29-d6dc790b66bd admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.218534 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1431/2850] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:01.222746 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.232786 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d52d98-212b-4a33-8ff5-4fc7166482f3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.237461 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.238334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.238619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.238896 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] PATH_INFO: `/v3/projects/1549aa14b4a44bf5bf5fad5d5204c64b/users/351f65571d434de1a0a62163418c8cee/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.254910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1549aa14b4a44bf5bf5fad5d5204c64b, user_id=351f65571d434de1a0a62163418c8cee, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.257516 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.270781 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1420/2851] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:01:01 2022] PUT /identity/v3/projects/1549aa14b4a44bf5bf5fad5d5204c64b/users/351f65571d434de1a0a62163418c8cee/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:01.281795 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.282113 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.282364 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.308341 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] MFA Rules not processed for user `351f65571d434de1a0a62163418c8cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:01.309561 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:01.372357 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1432/2852] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:01.385061 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:01.387104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:01.464913 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113526b-f017-4ce4-84a6-6ac049203783 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:01.468719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3860575c0bf3407198670e0f31ec2176', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:01.469364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:01.469674 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:01.469957 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:01.478201 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:01.479673 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403216-f65f-4679-bd1d-94c40bc519bf service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:01.488397 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1421/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:33.266053 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:33.328616 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936eb480-b4a9-41bb-b96e-38c454ed91e3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:33.333230 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:33.334107 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:33.334395 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:33.334676 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] PATH_INFO: `/v3/users/351f65571d434de1a0a62163418c8cee` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:33.335903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351f65571d434de1a0a62163418c8cee)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:33.337830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:33.383659 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351f65571d434de1a0a62163418c8cee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.384293 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351f65571d434de1a0a62163418c8cee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.396034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351f65571d434de1a0a62163418c8cee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.396701 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351f65571d434de1a0a62163418c8cee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.404168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351f65571d434de1a0a62163418c8cee'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.415982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1433/2854] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:01:33 2022] DELETE /identity/v3/users/351f65571d434de1a0a62163418c8cee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:33.421480 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:33.422138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:33.422138 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:33.440473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:33.441685 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:33.498489 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1422/2855] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:33.507999 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:33.509405 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:33.565993 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6414d-f454-4a8a-85fa-3062ef73eaa1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:33.569682 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:33.570365 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:33.570674 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:33.570924 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:33.580269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:33.581704 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc7e74-1264-4cdb-b9b0-f3f4c2b114b5 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:33.590930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1434/2856] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:01:33.854460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:33.855949 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:33.870905 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e72b9a-2064-41f1-8c10-13be05b130d1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:33.876796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:33.877731 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:33.877962 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:33.878271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] PATH_INFO: `/v3/projects/1549aa14b4a44bf5bf5fad5d5204c64b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:33.879488 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1549aa14b4a44bf5bf5fad5d5204c64b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:33.881402 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:33.928496 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1549aa14b4a44bf5bf5fad5d5204c64b', 'request_id': 'req-b40661d6-f9fa-4492-ac5d-083f2f5713b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.934875 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1549aa14b4a44bf5bf5fad5d5204c64b', 'request_id': 'req-b40661d6-f9fa-4492-ac5d-083f2f5713b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.941886 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1549aa14b4a44bf5bf5fad5d5204c64b', 'request_id': 'req-b40661d6-f9fa-4492-ac5d-083f2f5713b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.952856 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] The token cache is being invalidate because project 1549aa14b4a44bf5bf5fad5d5204c64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:01:33.953460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.954234 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b40661d6-f9fa-4492-ac5d-083f2f5713b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:33.955989 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1423/2857] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:01:33 2022] DELETE /identity/v3/projects/1549aa14b4a44bf5bf5fad5d5204c64b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:33.960830 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af294-0e76-419e-8221-66fd3137081d None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:33.961128 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af294-0e76-419e-8221-66fd3137081d None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:33.961414 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065af294-0e76-419e-8221-66fd3137081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:33.979448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-065af294-0e76-419e-8221-66fd3137081d None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:33.980655 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-065af294-0e76-419e-8221-66fd3137081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:34.040034 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1435/2858] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:34.098814 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.099107 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.099411 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.117668 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:34.118874 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:34.127157 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1424/2859] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:34.131390 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af294-0e76-419e-8221-66fd3137081d None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.141635 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065af294-0e76-419e-8221-66fd3137081d None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.146272 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.146929 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.147219 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.147535 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.148275 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:01:34.148588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.150189 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.162077 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1436/2860] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:01:34.166315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.175660 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06cd4a-51bb-48e4-9957-daf877272ad2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.180401 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.181051 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.181337 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.181613 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.182311 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.184243 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.209740 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1425/2861] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:01:34 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:34.213765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.224236 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f577b-e5a4-405a-8441-8f82017475a1 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.277720 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.278446 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.278657 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.278934 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.280346 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.282383 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.302297 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1437/2862] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:01:34 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 18:01:34.306341 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.316842 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018c5-e26d-40c5-a453-66a5986f4829 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.321346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.322018 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.322306 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.322595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.323334 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.325209 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.336340 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1426/2863] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:34.340585 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.351201 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ae970-4266-40e3-a6ad-af40c618e197 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.357978 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.358652 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.358931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.359206 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.359974 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.361555 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346a1c8-4a41-4e8e-9c8e-43cae2527b32 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.371559 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1438/2864] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:01:34.375895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.386883 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11928ebc-b6cd-4d08-a170-91e388296f17 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.392555 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.393452 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.393738 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.394019 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] PATH_INFO: `/v3/projects/b8a36740243c4a2cb070f1ceb326d016/users/b6a68512524f43c2bf0646b285abc294/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.409443 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a36740243c4a2cb070f1ceb326d016, user_id=b6a68512524f43c2bf0646b285abc294, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.412238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.425677 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1427/2865] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:01:34 2022] PUT /identity/v3/projects/b8a36740243c4a2cb070f1ceb326d016/users/b6a68512524f43c2bf0646b285abc294/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:34.435743 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.436153 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.436439 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.462491 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] MFA Rules not processed for user `b6a68512524f43c2bf0646b285abc294`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:34.463667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:34.525256 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1439/2866] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:01:34.537724 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:34.539608 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:34.596527 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8310cc-586a-484e-8499-443efaf23466 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:34.600160 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d12511650594add87c8753c0667d374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:34.600810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:34.601098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:34.601376 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:34.609679 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:34.611114 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889233a-c396-44eb-a369-151fce36e676 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:34.620120 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1428/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:42.806834 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:42.874651 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b95e-5ea6-44aa-bf1d-01446c44fb74 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:42.879277 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:42.880187 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:42.880475 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:42.880755 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] PATH_INFO: `/v3/users/b6a68512524f43c2bf0646b285abc294` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:42.882008 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a68512524f43c2bf0646b285abc294)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:42.884050 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:42.930813 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a68512524f43c2bf0646b285abc294'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:42.931558 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a68512524f43c2bf0646b285abc294'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:42.943172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a68512524f43c2bf0646b285abc294'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:42.943917 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a68512524f43c2bf0646b285abc294'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:42.951903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a68512524f43c2bf0646b285abc294'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:42.963982 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1440/2868] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:01:42 2022] DELETE /identity/v3/users/b6a68512524f43c2bf0646b285abc294 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:42.969232 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:42.969719 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:42.969847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:42.987094 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:42.988344 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:43.046526 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1429/2869] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:43.056242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.057629 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:43.116621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3128c-360d-4b5d-a14f-aa1cb8935ff6 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.120302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.120951 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.121239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.121521 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.130540 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.132255 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68e93b-3b03-432e-b2bc-1942b120de8b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.142249 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1441/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:43.411565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.413117 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:43.425828 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f151c-81c7-4f05-909c-533a62a9116f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.431395 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.432268 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.432563 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.432846 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] PATH_INFO: `/v3/projects/b8a36740243c4a2cb070f1ceb326d016` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.434062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a36740243c4a2cb070f1ceb326d016)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.436834 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.481895 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a36740243c4a2cb070f1ceb326d016', 'request_id': 'req-427f3fb6-b02d-4715-8fce-9c3009a66a97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:43.488039 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a36740243c4a2cb070f1ceb326d016', 'request_id': 'req-427f3fb6-b02d-4715-8fce-9c3009a66a97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:43.495191 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a36740243c4a2cb070f1ceb326d016', 'request_id': 'req-427f3fb6-b02d-4715-8fce-9c3009a66a97'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:43.505597 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] The token cache is being invalidate because project b8a36740243c4a2cb070f1ceb326d016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:01:43.505888 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:43.507109 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-427f3fb6-b02d-4715-8fce-9c3009a66a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:01:43.508110 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1430/2871] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:01:43 2022] DELETE /identity/v3/projects/b8a36740243c4a2cb070f1ceb326d016 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:43.513262 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.514104 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.514388 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.531903 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:43.533117 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:43.591664 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1442/2872] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:43.599494 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.599792 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.600075 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.619152 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:43.620404 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:43.629265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1431/2873] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 18:01:43.633423 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.643207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcfd7f-c4ad-4f0a-9598-f186e9c63c17 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.647930 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.648581 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.648867 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.649144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.649870 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80255) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 18:01:43.650172 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.651863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.666000 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1443/2874] 10.222.0.60 () {58 vars in 1152 bytes} [Tue May 10 18:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 18:01:43.671043 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.680431 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e51d-7917-4d23-95d8-2aeb074d4f3f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.685838 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.686589 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.686916 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.687195 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.687944 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.689847 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.714736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1432/2875] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:01:43 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:43.718866 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.728597 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f161d-dfce-4e3f-a8f4-3db29135cdf3 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.783863 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.784530 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.784814 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.785091 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.785787 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.787727 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.807537 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1444/2876] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:01:43 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:43.814789 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.825034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c5df6-7a77-4228-8828-3d57abf660d9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.830364 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.831025 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.831315 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.831653 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.832396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.833997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.846076 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1433/2877] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 18:01:43.850141 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.860728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3d85-e683-4975-8eda-133243cefa28 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.865337 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.865989 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.866273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.866549 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.867274 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.868960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e03fb-bde9-4dcf-8bce-fd44ba011a7c admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.879394 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1445/2878] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:43.883619 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:43.893817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db4756-cb47-4e45-8c87-9a20f8149bd4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:43.898429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:43.899301 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.899634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.899910 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] PATH_INFO: `/v3/projects/550c47b03653401d871922496e1cf055/users/ab98ef11f3714e27a2ba02402d142813/roles/c8cdd31ae58f4093a5a43e750e395e36` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.914034 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550c47b03653401d871922496e1cf055, user_id=ab98ef11f3714e27a2ba02402d142813, role_id=c8cdd31ae58f4093a5a43e750e395e36)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:43.916769 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:43.929941 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1434/2879] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:01:43 2022] PUT /identity/v3/projects/550c47b03653401d871922496e1cf055/users/ab98ef11f3714e27a2ba02402d142813/roles/c8cdd31ae58f4093a5a43e750e395e36 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:01:43.935015 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253168e-9af2-4162-b428-7bf4b857a2f1 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:43.935949 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253168e-9af2-4162-b428-7bf4b857a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:43.936227 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253168e-9af2-4162-b428-7bf4b857a2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:43.953780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-d253168e-9af2-4162-b428-7bf4b857a2f1 None None] MFA Rules not processed for user `cf223ad1bb814591a9871f0dc159ef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:43.954975 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-d253168e-9af2-4162-b428-7bf4b857a2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:44.012267 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1446/2880] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:44.023646 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:44.025430 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:44.080549 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3b48-2849-447d-bf88-081295940ab0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:44.084169 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:44.084810 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:44.085096 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:44.085374 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:44.094624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:44.096142 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:44.105473 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1435/2881] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:48.143106 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.143667 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.143839 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.171568 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.auth.core [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] MFA Rules not processed for user `ab98ef11f3714e27a2ba02402d142813`. Rule list: `[]` (Enabled: `True`). {{(pid=80255) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:48.172778 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:48.257129 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1447/2882] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:48.261634 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.274565 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54f78d-900f-4f3a-8a3a-866ee5ca8492 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.281617 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.282296 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.282818 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.283009 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.283796 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.285722 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.315212 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1436/2883] 10.222.0.60 () {60 vars in 1152 bytes} [Tue May 10 18:01:48 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:48.319269 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.331774 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75a536-4e24-4cbf-b828-11bc17a092a3 None None] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.394270 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.394994 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.395282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.395589 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.396294 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.398228 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.426363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1448/2884] 10.222.0.60 () {60 vars in 1143 bytes} [Tue May 10 18:01:48 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 18:01:48.430330 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.441300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dc2c2-7f68-485d-a788-a10a03841949 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.446736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.447490 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.447729 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.448011 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.448753 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.451150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.462909 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1437/2885] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:48.467956 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.478183 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3005e-384a-4236-a1d7-32bee4516e78 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.483717 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.484671 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.485019 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.485185 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] PATH_INFO: `/v3/projects/f0e5096864cf417181b16abc451a26f0/users/04c916fd7a22446e8256ac05456c65e7/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.502222 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e5096864cf417181b16abc451a26f0, user_id=04c916fd7a22446e8256ac05456c65e7, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.505023 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.522546 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1449/2886] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:01:48 2022] PUT /identity/v3/projects/f0e5096864cf417181b16abc451a26f0/users/04c916fd7a22446e8256ac05456c65e7/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:01:48.526568 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.536894 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac45eb-7d31-4940-a822-7b8cbe03fd71 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.598462 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.599177 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.599502 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.599788 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.600595 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.602362 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5f1d2-fe98-4b14-871d-b9c483fb8f61 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.613582 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1438/2887] 10.222.0.60 () {58 vars in 1121 bytes} [Tue May 10 18:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 18:01:48.618011 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:48.629440 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ece4f-20dd-4ff0-9891-c6948dd07f63 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:48.634317 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:48.635239 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:48.635571 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:48.635853 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] PATH_INFO: `/v3/projects/f0e5096864cf417181b16abc451a26f0/users/04c916fd7a22446e8256ac05456c65e7/roles/0d49494e76f84242bc3076803ab15e82` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:48.638617 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e5096864cf417181b16abc451a26f0, user_id=04c916fd7a22446e8256ac05456c65e7, role_id=0d49494e76f84242bc3076803ab15e82)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:48.641324 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:48.652323 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1450/2888] 10.222.0.60 () {60 vars in 1482 bytes} [Tue May 10 18:01:48 2022] PUT /identity/v3/projects/f0e5096864cf417181b16abc451a26f0/users/04c916fd7a22446e8256ac05456c65e7/roles/0d49494e76f84242bc3076803ab15e82 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:01:53.375266 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115c66-8fab-4e32-be84-447826eb292a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:53.375791 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115c66-8fab-4e32-be84-447826eb292a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:53.375879 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3115c66-8fab-4e32-be84-447826eb292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:53.407647 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b3115c66-8fab-4e32-be84-447826eb292a None None] MFA Rules not processed for user `04c916fd7a22446e8256ac05456c65e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:53.408317 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b3115c66-8fab-4e32-be84-447826eb292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:53.480745 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1439/2889] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:01:53.495654 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:01:53.497587 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:53.574976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c77b3f-96c7-4867-b67c-6ab16a61b2e9 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:01:53.582115 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:01:53.582788 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:53.583080 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:53.583402 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:53.647600 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:01:53.649209 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:01:53.663459 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1451/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:01:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:01:54.721624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:01:54.722149 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:01:54.722286 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:01:54.745179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] MFA Rules not processed for user `ab98ef11f3714e27a2ba02402d142813`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 18:01:54.746484 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:01:54.754816 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1440/2891] 10.222.0.60 () {58 vars in 957 bytes} [Tue May 10 18:01:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 18:02:14.400173 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:14.454477 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f467b4-d92f-4e61-82b9-865ee1003de8 service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:14.458263 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:14.458913 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:14.459204 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:14.459525 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:14.461330 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:14.471074 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:14.472588 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:14.480644 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1452/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:02:14.926736 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:14.928216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:14.998216 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76868fd0-f137-423b-8d86-41a1bde3ed5c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:15.003448 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:15.004104 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:15.004416 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:15.004692 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:15.006460 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:15.018655 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:15.020271 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:15.031050 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1441/2893] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:02:16.873457 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:16.874901 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:16.888276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06961e6f-cbfa-41ae-877e-eb196f62a4c6 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:16.892376 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:16.893038 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:16.893328 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:16.893613 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:16.895521 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:16.906710 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:16.908611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:16.916605 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1453/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:02:28.767525 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:28.769396 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:28.787882 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb069a-cd21-486b-9c92-ef521ec900ac service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:28.794550 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:28.795265 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:28.795767 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:28.796079 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:28.798088 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:28.815300 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:28.817144 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:28.831643 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1442/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:02:31.498823 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:31.507320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a7967-2441-49bb-938b-ae3c1fb90d56 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:31.510933 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:31.511761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:31.511965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:31.512242 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:31.521987 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:31.523495 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:31.533885 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1454/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:02:33.249263 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:02:33.260442 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652556-135d-4e14-b29d-357e2e84a00f service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:02:33.267005 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:02:33.267700 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:02:33.267997 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:02:33.268278 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:02:33.270242 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:02:33.282983 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:02:33.284624 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:02:33.295709 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1443/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:02:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 18:03:45.819765 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:03:45.821159 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:03:45.836289 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602b128-51ad-42a9-9ecc-ff394963665c service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:03:45.841384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:03:45.842036 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:03:45.842326 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:03:45.842608 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:03:45.844968 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:03:45.856712 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:03:45.858290 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:03:45.868781 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1455/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:03:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:04:47.306558 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:04:47.316463 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254d46-81f3-4852-80d2-907c253df632 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:04:47.321485 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:04:47.322124 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:04:47.322405 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:04:47.322680 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:04:47.324479 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:04:47.338464 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:04:47.339937 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:04:47.351238 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1444/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:04:48.523877 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:04:48.532965 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef4a3-83d3-4ca8-af75-c134e99909be service placement] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:04:48.536512 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:04:48.537144 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:04:48.537430 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:04:48.537707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:04:48.539462 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:04:48.552958 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:04:48.554363 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:04:48.565646 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1456/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:05:00.382920 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:05:00.391636 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba47b8-de3a-447c-bab4-33e5d19fe52e service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:05:00.395198 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:05:00.395860 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:05:00.396150 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:05:00.396429 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:05:00.398148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:05:00.407666 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:05:00.409098 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:05:00.416974 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1445/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:05:00.517510 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:05:00.527780 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed420c0-b947-4030-ac7d-e2c3b9469e9b service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:05:00.531707 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:05:00.532435 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:05:00.532983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:05:00.533367 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:05:00.535320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:05:00.545931 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:05:00.549001 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:05:00.559084 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1457/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:05:00.650522 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:05:00.659938 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec093aa-27de-4292-9738-d0c383ba9884 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:05:00.663908 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:05:00.664790 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:05:00.665148 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:05:00.665492 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:05:00.667280 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:05:00.682146 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:05:00.683603 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:05:00.694476 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1446/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:05:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:06:45.035282 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:45.050207 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97ecf4-c5ef-4ce0-b7d1-bc71494e0d27 service neutron] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:45.056083 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a3e49e317144906907311bac205bef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:45.056838 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:45.057198 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:45.057554 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:45.059550 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:06:45.073692 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:45.075415 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:45.088611 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1458/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:06:46.350113 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:46.359750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bb8f-548e-4694-bab5-40b5c204bd66 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:46.363385 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66e05683dc88495686fea4cf92a63928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:46.364045 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:46.364336 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:46.364618 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:46.425410 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:46.426880 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:46.436849 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1447/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 18:06:52.874098 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:52.926669 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80f6a7-d4b4-40b2-8deb-4386317187ae service nova] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:52.931445 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:52.932412 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:52.932698 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:52.932976 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] PATH_INFO: `/v3/users/ab98ef11f3714e27a2ba02402d142813` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:52.934168 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab98ef11f3714e27a2ba02402d142813)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:52.936283 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:52.980703 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab98ef11f3714e27a2ba02402d142813'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:52.981302 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab98ef11f3714e27a2ba02402d142813'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:52.993013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab98ef11f3714e27a2ba02402d142813'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:52.993728 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab98ef11f3714e27a2ba02402d142813'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.001448 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab98ef11f3714e27a2ba02402d142813'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.013213 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1459/2906] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:06:52 2022] DELETE /identity/v3/users/ab98ef11f3714e27a2ba02402d142813 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 18:06:53.180817 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:53.233073 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7da05-27c0-4a07-a862-54fbc6b7a830 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:53.287976 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:53.288764 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:53.289062 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:53.289346 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] PATH_INFO: `/v3/projects/550c47b03653401d871922496e1cf055` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:53.290543 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=550c47b03653401d871922496e1cf055)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:53.292500 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:53.337353 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550c47b03653401d871922496e1cf055', 'request_id': 'req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.343231 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550c47b03653401d871922496e1cf055', 'request_id': 'req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.350221 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550c47b03653401d871922496e1cf055', 'request_id': 'req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.371739 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] The token cache is being invalidate because project 550c47b03653401d871922496e1cf055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:06:53.372029 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.373168 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.374825 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1448/2907] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:06:53 2022] DELETE /identity/v3/projects/550c47b03653401d871922496e1cf055 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:06:53.378851 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:53.380276 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:06:53.402915 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e626-9120-4f1d-a24f-91e4423b3d52 admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:53.456960 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:53.457835 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:53.458125 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:53.458406 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] PATH_INFO: `/v3/users/04c916fd7a22446e8256ac05456c65e7` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:53.459645 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c916fd7a22446e8256ac05456c65e7)` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:53.461564 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:53.506353 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c916fd7a22446e8256ac05456c65e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.507013 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c916fd7a22446e8256ac05456c65e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.519857 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c916fd7a22446e8256ac05456c65e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.520621 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c916fd7a22446e8256ac05456c65e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.528761 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.notifications [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c916fd7a22446e8256ac05456c65e7'} {{(pid=80255) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.541932 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1460/2908] 10.222.0.60 () {58 vars in 1223 bytes} [Tue May 10 18:06:53 2022] DELETE /identity/v3/users/04c916fd7a22446e8256ac05456c65e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:06:53.719541 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:06:53.721001 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:06:53.736349 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcb5a6-26c4-4304-ae14-b83e54a2dd6a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:06:53.796371 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf223ad1bb814591a9871f0dc159ef4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05b43e5ee8d94e7eabaa576aaa97efc1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:06:53.797179 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:06:53.797468 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:06:53.797750 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] PATH_INFO: `/v3/projects/f0e5096864cf417181b16abc451a26f0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:06:53.798963 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e5096864cf417181b16abc451a26f0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:06:53.800919 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:06:53.847661 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e5096864cf417181b16abc451a26f0', 'request_id': 'req-df7faf00-e104-4805-b27c-22591c8074a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.853552 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e5096864cf417181b16abc451a26f0', 'request_id': 'req-df7faf00-e104-4805-b27c-22591c8074a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.861175 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e5096864cf417181b16abc451a26f0', 'request_id': 'req-df7faf00-e104-4805-b27c-22591c8074a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.870766 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] The token cache is being invalidate because project f0e5096864cf417181b16abc451a26f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 18:06:53.871054 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.871681 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-df7faf00-e104-4805-b27c-22591c8074a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 18:06:53.873826 dv-cinder-841302-2-iscsi devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1449/2909] 10.222.0.60 () {58 vars in 1232 bytes} [Tue May 10 18:06:53 2022] DELETE /identity/v3/projects/f0e5096864cf417181b16abc451a26f0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 18:08:51.818660 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Authenticating user token {{(pid=80255) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 18:08:51.820190 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:08:51.926046 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b52126-b36d-4abd-b653-8e1ddab2215f admin admin] Validating token access rules against request {{(pid=80255) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 18:08:51.982320 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228acc1362ed42cc82e3f5ddc0467ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd020f9d4f9d143d287364c7b28282287', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80255) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 18:08:51.982983 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] REQUEST_METHOD: `GET` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 18:08:51.983273 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] SCRIPT_NAME: `/identity` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 18:08:51.983584 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80255) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 18:08:51.985384 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.fernet_utils [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80255) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 18:08:51.997096 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 18:08:51.998668 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45765f4-2fa0-4bc4-85ab-cf9219aa9ff0 service placement] RBAC: Authorization granted {{(pid=80255) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 18:08:52.009165 dv-cinder-841302-2-iscsi devstack@keystone.service[80255]: [pid: 80255|app: 0|req: 1461/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Tue May 10 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)